00000001:02000400:0.0F:1787784225.829250:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787784234.559043:0:3170:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787784235.440549:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1327 MB/s 00000001:01000000:1.0:1787784235.690800:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1655 MB/s 00000001:01000000:1.0:1787784235.940440:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9995 MB/s 00000020:02000000:0.0:1787784236.220977:0:3262:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_54_g0142cbb 00000400:02000000:2.0:1787784236.579840:0:3277:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.159@tcp [8/256/0/180] 00008000:02000000:3.0F:1787784240.028249:0:3426:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787784304.532133:0:5230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787784315.389215:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787784315.389221:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787784315.389349:0:5812:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002f76cc9a 00000080:02000400:0.0:1787784315.389362:0:5812:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787784315.393872:0:5812:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787784315.393890:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787784315.393945:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f220d950) 00000020:00000080:0.0:1787784315.393970:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787784315.423632:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787784315.426840:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787784315.484592:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787784315.484638:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787784315.484659:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787784315.484713:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787784315.484738:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787784315.488503:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787784315.488514:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787784315.488527:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba66a 00000020:01000004:0.0:1787784315.488536:0:5812:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787784315.488541:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787784315.488547:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f76cc9a from MGS 00000020:01000004:0.0:1787784315.488553:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787784315.488565:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d82271ef) 00000020:00000080:0.0:1787784315.488586:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787784315.488645:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f76cc9a from MGS, refs=2 00080000:01000000:0.0:1787784315.488650:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784315.488654:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba678 00000100:00100000:0.0:1787784315.489002:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787784315.489882:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787784315.489897:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787784315.491572:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787784315.491583:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787784315.493067:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784315.493276:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787784315.493281:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787784315.494434:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787784315.494443:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787784315.494817:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787784315.494824:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787784315.495598:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784315.495602:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784315.495603:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784315.496704:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784315.496708:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784315.496710:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784315.498026:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787784315.503045:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787784315.747511:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2475 MB/s 00000001:01000000:2.0:1787784315.997898:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2775 MB/s 00000001:01000000:2.0:1787784316.247824:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 587 MB/s 00000001:01000000:1.0:1787784316.498803:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 529 MB/s 00080000:10000000:1.0:1787784316.507745:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1787784316.532466:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787784316.544639:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787784316.544666:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787784316.544669:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787784316.546192:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787784316.546326:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787784316.546405:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787784316.546575:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787784316.546595:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787784316.546879:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784316.547555:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787784316.547563:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787784316.560722:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787784316.560739:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787784316.563526:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787784316.563539:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787784316.575724:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787784316.575752:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.159@tcp' 00000020:01000004:1.0:1787784316.575753:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787784316.575798:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.159@tcp (typ=mgc) 00000020:00000080:1.0:1787784316.575832:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.159@tcp (00000000cd5b44ef) 00000020:00000080:1.0:1787784316.575855:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787784316.575989:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002daacf06@MGC192.168.202.159@tcp: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1787784316.576158:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.159@tcp-0 is initialized 00000040:01000000:1.0:1787784316.576166:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787784316.581260:0:5827:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787784316.581327:0:5828:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787784316.581389:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.159@tcp (uuid 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5) 00000020:00000080:3.0:1787784316.581413:0:5812:0:(genops.c:1385:class_connect()) connect: client 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5, cookie 0xffb8d925c20ba686 00000100:00080000:3.0:1787784316.581426:0:5812:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784316.581433:0:5812:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import 000000002daacf06 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784316.581465:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a76b2491 x1874627643048064/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787784316.581487:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS 00000020:01000004:3.0:1787784316.581506:0:5812:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787784316.581511:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787784316.581544:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000416e62c3) 00000020:00000080:3.0:1787784316.581558:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787784316.593166:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a76b2491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643048064:0@lo:250: 00000100:00100000:2.0:1787784316.594478:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784316.603628:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048064 00000100:00100000:0.0:1787784316.603647:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048064 00000100:00100000:0.0:1787784316.603689:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784316.603697:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6622c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3292:x1874627643048064:12345-0@lo:250: 00010000:00080000:0.0:1787784316.603726:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:0.0:1787784316.603776:0:5823:0:(genops.c:1385:class_connect()) connect: client 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5, cookie 0xffb8d925c20ba694 00000100:00080000:0.0:1787784316.603948:0:5823:0:(import.c:65:import_set_state_nolock()) 00000000d11b1c59 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784316.604056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6622c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:3292:x1874627643048064:12345-0@lo:250: Request processed in 358us (9581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784316.604064:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784316.607051:0:3292:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787784316.607068:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.159@tcp: connect to target with instance 0 00000100:00080000:2.0:1787784316.607076:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787784316.607082:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787784316.607085:0:3292:0:(import.c:65:import_set_state_nolock()) 000000002daacf06 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787784316.607089:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787784316.607092:0:3292:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787784316.607099:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a76b2491 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643048064:0@lo:250: 00000100:00100000:2.0:1787784316.609354:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784316.609607:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784316.609615:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787784316.619648:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787784316.619693:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787784316.622931:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784316.622947:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787784316.623726:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784316.624160:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787784316.624166:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787784316.626862:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787784316.626877:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787784316.691340:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784316.691583:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787784316.691593:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787784316.700354:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787784316.700424:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787784316.701477:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784316.701677:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784316.701684:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787784316.702677:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787784316.702686:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787784316.708119:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784316.708584:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784316.708591:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787784316.714245:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784316.714265:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787784316.720943:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784316.722207:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787784316.722214:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787784316.722924:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787784316.722931:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787784316.791062:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784316.792146:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787784316.792743:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787784316.798826:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784316.798846:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787784316.804967:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784316.804997:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787784316.807657:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787784316.807698:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787784316.807707:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787784316.807977:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784316.808020:0:5812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787784316.808024:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784316.808026:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784316.808027:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784316.808028:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784316.808030:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784316.808031:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784316.808032:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784316.808033:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784316.808034:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784316.808036:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784316.808037:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784316.808039:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784316.808041:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787784316.808043:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784316.808044:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784316.808045:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784316.808046:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784316.808047:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784316.808049:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784316.808049:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784316.808050:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784316.808051:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784316.808052:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784316.808053:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784316.808054:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784316.808086:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787784316.808110:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041eab629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048192:0@lo:253: 00000100:00100000:2.0:1787784316.808784:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784316.808895:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e319f57 going to sleep for 11 seconds 00000100:00100000:1.0:1787784316.819913:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048192 00000100:00100000:1.0:1787784316.819931:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048192 00000100:00100000:1.0:1787784316.820807:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784316.820825:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005203d9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5812:x1874627643048192:12345-0@lo:253: 20000000:01000000:1.0:1787784316.820924:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787784316.820928:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787784316.824167:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787784316.824788:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787784316.825177:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784316.830447:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787784316.832144:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787784316.832150:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787784316.832165:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787784316.832169:0:5826:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787784316.832186:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787784316.834314:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784316.836117:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787784316.836161:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787784316.836229:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787784316.836282:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787784316.836338:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787784316.836523:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787784316.836533:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787784316.840044:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787784316.840074:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787784316.840145:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787784316.840166:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787784316.840203:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787784316.840258:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787784316.840327:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787784316.840335:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787784316.840352:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784316.840620:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787784316.840631:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787784316.840662:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787784316.840696:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787784316.840752:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787784316.840763:0:5826:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787784316.840834:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787784316.840843:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787784316.840883:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787784316.840930:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787784316.840963:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787784316.840974:0:5826:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787784316.841064:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787784316.841073:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787784316.841104:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787784316.841150:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787784316.841313:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787784316.841362:0:5826:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787784316.841394:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787784316.844717:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787784316.845261:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787784316.845294:0:5826:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.159@tcp for mdt 20000000:01000000:0.0:1787784316.845296:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:0.0:1787784316.845334:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787784316.845342:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787784316.845407:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787784316.845415:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:0.0:1787784316.845480:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787784316.845499:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787784316.845533:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787784316.846638:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787784316.846779:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787784316.846783:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787784316.846788:0:5826:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787784316.846795:0:5826:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787784316.847952:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787784316.848188:0:5826:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787784316.854848:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787784316.854983:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787784316.855068:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787784316.855088:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787784316.855090:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787784316.855094:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787784316.855132:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787784316.855136:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787784316.855285:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787784316.855288:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787784316.855892:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787784316.867829:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787784316.867871:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787784316.867988:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1787784316.868008:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787784316.868010:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787784316.869729:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787784316.870271:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787784316.870323:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787784316.870361:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787784316.870729:0:5826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784316.870731:0:5826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1787784316.870739:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787784316.870760:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870778:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870788:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870804:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870810:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870816:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870822:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000336af477 already unused, calling callback (00000000b7ddfb4e) 00010000:00010000:0.0:1787784316.870825:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870832:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870845:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870852:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784316.870857:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000336af477/0xffb8d925c20ba69b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784316.870874:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787784317.190710:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005203d9b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5812:x1874627643048192:12345-0@lo:253: Request processed in 369884us (381919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784317.190732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784317.190844:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041eab629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048192:0@lo:253: 10000000:01000000:2.0:1787784317.190861:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787784317.190881:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784317.190883:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787784317.190885:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784317.190886:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787784317.190887:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784317.190888:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784317.190890:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787784317.190891:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787784317.190892:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787784317.190894:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784317.190895:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784317.190928:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f76cc9a from lustre-MDT0000 10000000:01000000:2.0:1787784317.191024:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787784317.191027:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787784317.191032:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9431857819b8 10000000:01000000:2.0:1787784317.191036:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784317.191044:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431857819b8 from 1 10000000:01000000:2.0:1787784317.191047:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787784317.191086:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784317.191096:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784317.191105:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784317.191125:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041eab629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048320:0@lo:101: 00000100:00100000:2.0:1787784317.191161:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784317.191259:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b732a2ee going to sleep for 11 seconds 00000100:00100000:1.0:1787784317.191524:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048320 00000100:00100000:1.0:1787784317.191532:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048320 00000100:00100000:1.0:1787784317.191686:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784317.191695:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8edb594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5812:x1874627643048320:12345-0@lo:101: 00010000:00010000:1.0:1787784317.191710:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784317.191725:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3de231b/0xffb8d925c20ba6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba6a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.191748:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3de231b/0xffb8d925c20ba6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.191757:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3de231b/0xffb8d925c20ba6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.191765:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3de231b, rc 0) 00000100:00100000:1.0:1787784317.191841:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8edb594 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:5812:x1874627643048320:12345-0@lo:101: Request processed in 148us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.191848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784317.191932:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041eab629 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048320:0@lo:101: 00010000:00010000:3.0:1787784317.191946:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.191966:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.192023:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048448:0@lo:501: 00000100:00100000:3.0:1787784317.192050:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.192194:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000004912dad6 going to sleep for 11 seconds 00000100:00100000:2.0:1787784317.192268:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048448 00000100:00100000:2.0:1787784317.192272:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048448 00000100:00100000:2.0:1787784317.192305:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784317.192311:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cbcb4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:5812:x1874627643048448:12345-0@lo:501: 00000100:00100000:2.0:1787784317.192629:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cbcb4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:5812:x1874627643048448:12345-0@lo:501: Request processed in 318us (578us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784317.192636:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784317.192853:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048448:0@lo:501: 10000000:01000000:3.0:1787784317.192879:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787784317.192897:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.192914:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000e13636ac/0xffb8d925c20ba6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784317.192922:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94318875c800 10000000:01000000:3.0:1787784317.192927:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787784317.192931:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94318875c800 10000000:01000000:3.0:1787784317.192933:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787784317.192936:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff94318875c800 from 1 10000000:01000000:3.0:1787784317.192939:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787784317.193081:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193096:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193106:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.193121:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048576:0@lo:101: 00000100:00100000:3.0:1787784317.193155:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.193218:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000004912dad6 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.193279:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048576 00000100:00100000:0.0:1787784317.193284:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048576 00000100:00100000:2.0:1787784317.193334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784317.193343:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3f80039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:5812:x1874627643048576:12345-0@lo:101: 00010000:00010000:2.0:1787784317.193352:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784317.193378:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2236dc2/0xffb8d925c20ba6b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba6b0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784317.193397:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2236dc2/0xffb8d925c20ba6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba6b0 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784317.193406:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2236dc2/0xffb8d925c20ba6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba6b0 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784317.193414:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2236dc2, rc 0) 00000100:00100000:2.0:1787784317.193545:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3f80039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+7:5812:x1874627643048576:12345-0@lo:101: Request processed in 204us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784317.193552:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784317.193756:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048576:0@lo:101: 00010000:00010000:3.0:1787784317.193767:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193775:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784317.193788:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787784317.193837:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193844:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000d79208e0/0xffb8d925c20ba6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784317.193851:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784317.193854:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784317.193859:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94318875c800 10000000:01000000:3.0:1787784317.193862:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787784317.193865:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787784317.193875:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784317.193891:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193898:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.193915:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.193927:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048704:0@lo:101: 00000100:00100000:3.0:1787784317.193965:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.193990:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000004912dad6 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.194099:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048704 00000100:00100000:0.0:1787784317.194103:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048704 00000100:00100000:0.0:1787784317.194135:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784317.194149:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc660fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+7:5812:x1874627643048704:12345-0@lo:101: 00010000:00010000:0.0:1787784317.194157:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784317.194165:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000336af477/0xffb8d925c20ba6c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba6be expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.194178:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000336af477/0xffb8d925c20ba6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.194185:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000336af477/0xffb8d925c20ba6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.194191:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000336af477, rc 0) 00000100:00100000:0.0:1787784317.194231:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc660fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:5812:x1874627643048704:12345-0@lo:101: Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.194237:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784317.194327:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048704:0@lo:101: 00010000:00010000:1.0:1787784317.194337:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.194344:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784317.194404:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048832:0@lo:501: 00000100:00100000:1.0:1787784317.194432:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784317.194468:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e09b5fe2 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.194589:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048832 00000100:00100000:0.0:1787784317.194593:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048832 00000100:00100000:0.0:1787784317.194623:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784317.194629:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2f61f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:5812:x1874627643048832:12345-0@lo:501: 00000100:00100000:0.0:1787784317.194851:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2f61f32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5812:x1874627643048832:12345-0@lo:501: Request processed in 222us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.194859:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784317.195074:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048832:0@lo:501: 00000100:00100000:1.0:1787784317.195101:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048960:0@lo:503: 00000100:00100000:1.0:1787784317.195140:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784317.195162:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e09b5fe2 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.195216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643048960 00000100:00100000:0.0:1787784317.195221:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643048960 00000100:00100000:0.0:1787784317.195250:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784317.195255:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4587855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5812:x1874627643048960:12345-0@lo:503: 00000100:00100000:0.0:1787784317.195419:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4587855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5812:x1874627643048960:12345-0@lo:503: Request processed in 163us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.195434:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784317.195574:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643048960:0@lo:503: 00000100:00100000:3.0:1787784317.196044:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5854:1874627643049088:0@lo:502: 00000100:00100000:3.0:1787784317.196081:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.196111:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d1c2cc68 going to sleep for 11 seconds 00000100:00100000:1.0:1787784317.196166:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049088 00000100:00100000:1.0:1787784317.196170:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049088 00000100:00100000:1.0:1787784317.196202:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784317.196208:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f2c4674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5854:x1874627643049088:12345-0@lo:502: 00000100:00100000:1.0:1787784317.196394:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f2c4674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5854:x1874627643049088:12345-0@lo:502: Request processed in 185us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.196401:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784317.196546:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5854:1874627643049088:0@lo:502: 00000020:01000000:3.0:1787784317.196582:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784317.196593:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784317.196596:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787784317.196601:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787784317.196603:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784317.196620:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002144308a) 00000020:00000080:3.0:1787784317.196638:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787784317.196644:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787784317.196734:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787784317.196743:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba6d3 00000020:00000080:3.0:1787784317.197138:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787784317.197143:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784317.197147:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784317.197157:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787784317.197161:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784317.197164:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784317.197166:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787784317.197169:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784317.197176:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c29e2644) 00000020:00000080:3.0:1787784317.197186:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787784317.197190:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787784317.197191:0:5854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787784317.197194:0:5854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787784317.197200:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787784317.197242:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f76cc9a from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787784317.197254:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b4172171) 00000020:00000080:3.0:1787784317.197271:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787784317.197321:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787784317.197327:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20ba6e8 00000020:00000080:3.0:1787784317.197666:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787784317.197674:0:5854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787784317.197680:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xffb8d925c20ba6ef 00080000:01000000:3.0:1787784317.197685:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787784317.197689:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba6f6 00080000:10000000:3.0:1787784317.198246:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787784317.198751:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787784317.202752:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787784317.275001:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787784317.275916:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787784317.280135:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787784317.280836:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787784317.337117:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e0683d55) 00000020:00000080:3.0:1787784317.337139:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787784317.337305:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787784317.337312:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba704 00000020:00000080:3.0:1787784317.338570:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787784317.341937:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784317.398913:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784317.423935:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784317.463613:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784317.520800:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784317.539247:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787784317.556546:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787784317.564193:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xffb8d925c20ba70b 00000020:00000080:2.0:1787784317.565430:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787784317.565568:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784317.565577:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784317.565579:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787784317.565595:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784317.565602:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784317.565604:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787784317.565608:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787784317.565656:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787784317.565674:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784317.565678:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784317.565680:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787784317.565682:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784317.565685:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784317.565686:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784317.565689:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784317.565690:0:5854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784317.565739:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027f87cbd pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5854:1874627643049216:0@lo:502: 00000100:00100000:2.0:1787784317.565820:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784317.565936:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a82ef767 going to sleep for 11 seconds 00000100:00100000:3.0:1787784317.566185:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049216 00000100:00100000:3.0:1787784317.566192:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049216 00000100:00100000:3.0:1787784317.566259:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784317.566266:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fd3748e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5854:x1874627643049216:12345-0@lo:502: 00000100:00100000:3.0:1787784317.566820:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fd3748e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5854:x1874627643049216:12345-0@lo:502: Request processed in 554us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784317.566827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787784317.567241:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027f87cbd pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5854:1874627643049216:0@lo:502: 00000020:01000000:2.0:1787784317.567266:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784317.567271:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784317.567273:0:5854:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784317.567275:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787784317.567454:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787784317.567470:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787784317.567484:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.567492:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000979dbc91/0xffb8d925c20ba6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784317.567498:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94318875c800 from 1 10000000:01000000:0.0:1787784317.567500:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784317.567526:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.567530:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.567536:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784317.567548:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049344:0@lo:101: 00000100:00100000:0.0:1787784317.567575:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.567786:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc7d32 going to sleep for 11 seconds 00000100:00100000:1.0:1787784317.567852:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049344 00000100:00100000:1.0:1787784317.567858:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049344 00000100:00100000:1.0:1787784317.567889:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784317.567895:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001070b96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:5812:x1874627643049344:12345-0@lo:101: 00010000:00010000:1.0:1787784317.567918:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784317.567931:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba712 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.568019:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.568029:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.568039:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036e5a8e5, rc 0) 00000100:00100000:1.0:1787784317.568080:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001070b96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:5812:x1874627643049344:12345-0@lo:101: Request processed in 185us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.568098:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784317.568180:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049344:0@lo:101: 00010000:00010000:0.0:1787784317.568190:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.568196:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784317.568712:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049472:0@lo:256: 00000100:00100000:0.0:1787784317.568749:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.568772:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc7d32 going to sleep for 11 seconds 00000100:00100000:1.0:1787784317.568851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049472 00000100:00100000:1.0:1787784317.568855:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049472 00000100:00100000:1.0:1787784317.568871:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784317.568874:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c01a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:5812:x1874627643049472:12345-0@lo:256: 20000000:01000000:1.0:1787784317.568886:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787784317.568890:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787784317.568981:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c01a3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:5812:x1874627643049472:12345-0@lo:256: Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.568986:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787784317.569167:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049472:0@lo:256: 10000000:01000000:0.0:1787784317.569719:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787784317.569739:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.569748:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784317.569756:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94318875c800 from 1 10000000:01000000:0.0:1787784317.569759:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784317.569783:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.569790:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.569796:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784317.569806:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049600:0@lo:101: 00000100:00100000:0.0:1787784317.569832:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.569952:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc7d32 going to sleep for 11 seconds 00000100:00100000:2.0:1787784317.570037:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049600 00000100:00100000:2.0:1787784317.570042:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049600 00000100:00100000:1.0:1787784317.570087:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784317.570094:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bba52d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:5812:x1874627643049600:12345-0@lo:101: 00010000:00010000:1.0:1787784317.570104:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784317.570114:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba720 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.570129:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.570135:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.570141:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d34b588e, rc 0) 00000100:00100000:1.0:1787784317.570170:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bba52d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049600:12345-0@lo:101: Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.570174:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784317.570232:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049600:0@lo:101: 00010000:00010000:0.0:1787784317.570240:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.570254:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784317.570289:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049728:0@lo:501: 00000100:00100000:0.0:1787784317.570307:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.570323:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc7d32 going to sleep for 11 seconds 00000100:00100000:3.0:1787784317.570384:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049728 00000100:00100000:3.0:1787784317.570389:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049728 00000100:00100000:3.0:1787784317.570412:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784317.570416:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000968e52f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049728:12345-0@lo:501: 00000100:00100000:3.0:1787784317.570914:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000968e52f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049728:12345-0@lo:501: Request processed in 495us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784317.570921:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784317.571130:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049728:0@lo:501: 00000100:00100000:0.0:1787784317.571155:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049856:0@lo:503: 00000100:00100000:0.0:1787784317.571182:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.571205:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000000cbc7d32 going to sleep for 11 seconds 00000100:00100000:3.0:1787784317.571240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049856 00000100:00100000:3.0:1787784317.571243:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049856 00000100:00100000:3.0:1787784317.571290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784317.571295:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1e2ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049856:12345-0@lo:503: 00000040:00080000:3.0:1787784317.571321:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784317.571384:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1e2ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049856:12345-0@lo:503: Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784317.571391:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784317.571519:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049856:0@lo:503: 00000040:00080000:0.0:1787784317.572676:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787784317.573102:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787784317.573120:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784317.573172:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.573200:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784317.573245:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784317.573248:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94318875c800 10000000:01000000:3.0:1787784317.573250:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94318875c800 10000000:01000000:3.0:1787784317.573255:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784317.573260:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94318875c800 from 1 10000000:01000000:3.0:1787784317.573263:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784317.573295:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.573302:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.573311:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.573331:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049984:0@lo:101: 00000100:00100000:3.0:1787784317.573538:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.573611:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efdfb125 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.573739:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643049984 00000100:00100000:0.0:1787784317.573746:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643049984 00000100:00100000:1.0:1787784317.573886:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784317.573895:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e147ff63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643049984:12345-0@lo:101: 00010000:00010000:1.0:1787784317.573926:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784317.573939:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7e7d2a0/0xffb8d925c20ba735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba72e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.574032:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7e7d2a0/0xffb8d925c20ba735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.574043:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7e7d2a0/0xffb8d925c20ba735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.574051:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7e7d2a0, rc 0) 00000100:00100000:1.0:1787784317.574097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e147ff63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643049984:12345-0@lo:101: Request processed in 204us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.574105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784317.574170:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643049984:0@lo:101: 00010000:00010000:3.0:1787784317.574184:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.574192:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.574253:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050112:0@lo:501: 00000100:00100000:3.0:1787784317.574279:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.574359:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efdfb125 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.574485:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050112 00000100:00100000:0.0:1787784317.574489:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050112 00000100:00100000:0.0:1787784317.574511:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784317.574516:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cd3fd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643050112:12345-0@lo:501: 00000100:00100000:0.0:1787784317.574774:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cd3fd73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643050112:12345-0@lo:501: Request processed in 257us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.574782:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784317.574909:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050112:0@lo:501: 00000100:00100000:3.0:1787784317.574937:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050240:0@lo:503: 00000100:00100000:3.0:1787784317.574984:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.575002:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efdfb125 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.575081:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050240 00000100:00100000:0.0:1787784317.575085:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050240 00000100:00100000:0.0:1787784317.575102:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784317.575107:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a6e10e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643050240:12345-0@lo:503: 00000100:00100000:0.0:1787784317.575328:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a6e10e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643050240:12345-0@lo:503: Request processed in 221us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.575335:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784317.575439:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050240:0@lo:503: 00000100:00100000:3.0:1787784317.575784:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5859:1874627643050368:0@lo:502: 00000100:00100000:3.0:1787784317.575821:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.575845:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000484f433a going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.575884:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050368 00000100:00100000:0.0:1787784317.575888:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050368 00000100:00100000:0.0:1787784317.575914:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784317.575920:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081313ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5859:x1874627643050368:12345-0@lo:502: 00000100:00100000:0.0:1787784317.576069:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081313ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5859:x1874627643050368:12345-0@lo:502: Request processed in 149us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.576076:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784317.576180:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5859:1874627643050368:0@lo:502: 00000020:01000004:3.0:1787784317.576236:0:5859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787784317.576252:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dcdaaa63) 00000020:00000080:3.0:1787784317.576271:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787784317.576335:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f76cc9a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787784317.576339:0:5859:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002f76cc9a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787784317.576341:0:5859:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002f76cc9a 4 00010000:00080000:3.0:1787784317.576400:0:5859:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000015f4fcc4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1787784317.577800:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787784317.579053:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787784317.579094:0:5859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787784317.579110:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xffb8d925c20ba743 00000100:00080000:3.0:1787784317.579124:0:5859:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784317.579129:0:5859:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015f4fcc4 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784317.579170:0:5859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bbff0a1c x1874627643050496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784317.579208:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643050496:0@lo:38: 00000100:00100000:3.0:1787784317.579271:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.579319:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050496 00000100:00100000:3.0:1787784317.579324:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050496 00000100:00100000:3.0:1787784317.579354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784317.579360:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb4060d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643050496:12345-0@lo:38: 00000100:00100000:3.0:1787784317.579418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb4060d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643050496:12345-0@lo:38: Request processed in 57us (146us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787784317.579423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784317.581042:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787784317.581054:0:3292:0:(import.c:65:import_set_state_nolock()) 0000000015f4fcc4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787784317.581077:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787784317.581081:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643050496:0@lo:38: 00000100:00080000:3.0:1787784317.581111:0:5859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787784317.581734:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5859:1874627643050624:0@lo:502: 00000100:00100000:3.0:1787784317.581822:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.581863:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bc6bb13b going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.583652:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050624 00000100:00100000:0.0:1787784317.583665:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050624 00000100:00100000:0.0:1787784317.583715:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784317.583725:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbbc57e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5859:x1874627643050624:12345-0@lo:502: 00000100:00100000:0.0:1787784317.586310:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbbc57e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5859:x1874627643050624:12345-0@lo:502: Request processed in 2581us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.586325:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784317.586558:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5859:1874627643050624:0@lo:502: 00000040:00080000:3.0:1787784317.586599:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787784317.586739:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787784317.586758:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784317.586781:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.586791:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000816e2ed4/0xffb8d925c20ba72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787784317.586843:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787784317.586845:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784317.586846:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784317.586852:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784317.586853:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784317.586855:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784317.586856:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784317.586857:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784317.586858:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784317.586859:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784317.586861:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784317.586862:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784317.586865:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787784317.586867:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784317.586868:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784317.586869:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784317.586870:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784317.586871:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784317.586872:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784317.586873:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784317.586874:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784317.586874:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784317.586875:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784317.586876:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784317.586877:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784317.586912:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787784317.586927:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050752:0@lo:253: 00000100:00100000:0.0:1787784317.587103:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784317.587143:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b88c9aa going to sleep for 11 seconds 00000100:00100000:3.0:1787784317.587189:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050752 00000100:00100000:3.0:1787784317.587195:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050752 00000100:00100000:3.0:1787784317.587273:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784317.587282:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089da4f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5812:x1874627643050752:12345-0@lo:253: 20000000:01000000:3.0:1787784317.587306:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787784317.587324:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784317.618920:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784317.619036:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787784317.619807:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787784317.619813:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787784317.619833:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.619852:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.619861:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.619909:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.619925:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 12 pid: 5823 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784317.619969:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643050880:0@lo:104: 00000100:00100000:1.0:1787784317.620036:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784317.620091:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbfb9e68 going to sleep for 11 seconds 00000100:00100000:0.0:1787784317.620207:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643050880 00000100:00100000:0.0:1787784317.620216:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643050880 00000100:00100000:0.0:1787784317.620275:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784317.620284:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b5f0ed2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643050880:12345-0@lo:104: 00010000:00010000:0.0:1787784317.620295:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784317.620351:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784317.620386:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b5f0ed2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643050880:12345-0@lo:104: Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784317.620395:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784317.620882:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d8abbe5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643050880:0@lo:104: 00010000:00010000:1.0:1787784317.620916:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621059:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784317.621065:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621073:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045eb1b0a already unused, calling callback (0000000058fa8176) 10000000:00010000:3.0:1787784317.621076:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621084:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784317.621091:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784317.621097:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784317.621138:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621145:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784317.621168:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621174:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: 0000000045eb1b0a/0xffb8d925c20ba712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621192:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784317.621194:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784317.621195:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784317.621266:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643051008:0@lo:103: 00000100:00100000:3.0:1787784317.621317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784317.621434:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051008 00000100:00100000:3.0:1787784317.621440:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051008 00010000:00010000:3.0:1787784317.621660:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 13 pid: 5823 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784317.621739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784317.621748:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010ae4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3294:x1874627643051008:12345-0@lo:103: 00010000:00010000:3.0:1787784317.621762:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784317.621767:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 13 pid: 5823 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621776:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 13 pid: 5823 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621790:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036e5a8e5/0xffb8d925c20ba719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba712 expref: 13 pid: 5823 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621805:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621813:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784317.621828:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002015849s 00010000:00010000:3.0:1787784317.621833:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621839:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621844:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621861:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621866:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c93b354 already unused, calling callback (00000000b7ddfb4e) 00010000:00010000:3.0:1787784317.621869:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621876:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621905:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784317.621919:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784317.621968:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010ae4162 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3294:x1874627643051008:12345-0@lo:103: Request processed in 222us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784317.621975:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787784317.622016:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.622024:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784317.622029:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c93b354/0xffb8d925c20ba74a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784317.622474:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bbff0a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643051008:0@lo:103: 00000100:00100000:1.0:1787784317.630885:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089da4f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5812:x1874627643050752:12345-0@lo:253: Request processed in 43593us (43770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784317.630912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787784317.631068:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5812:1874627643050752:0@lo:253: 10000000:01000000:3.0:1787784317.631085:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787784317.631089:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784317.631091:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784317.631093:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784317.631094:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784317.631095:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784317.631096:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784317.631098:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784317.631099:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784317.631100:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787784317.631102:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787784317.631103:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784317.631105:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784317.631121:0:5812:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787784317.638671:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.639220:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784317.639619:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.639799:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784317.640085:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.640251:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784317.641324:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.641679:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784317.641861:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.642124:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784317.642300:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784317.642758:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787784317.684408:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787784317.726756:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787784317.727145:0:5864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787784317.727149:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787784317.727226:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787784317.730682:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787784317.730886:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787784317.731296:0:5812:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787784317.731303:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787784317.731471:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784317.733318:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787784317.733931:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787784317.733976:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787784317.734279:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787784317.734516:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787784317.735743:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787784317.735881:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787784317.737259:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787784317.738073:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787784317.738286:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787784317.738558:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787784317.738729:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787784317.738999:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787784317.739162:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787784317.739306:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787784317.739725:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787784317.739943:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787784317.740343:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787784317.740756:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787784317.740936:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787784317.741077:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787784317.741427:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787784317.741840:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787784317.742054:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787784317.742196:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787784317.742346:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787784317.742710:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787784317.742948:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787784317.743093:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787784317.743261:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787784317.743594:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787784317.743768:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787784317.744092:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787784317.744271:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787784317.744787:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787784317.745067:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787784317.757768:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787784317.759313:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787784317.790281:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787784317.905809:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787784317.905877:0:5812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46dc1c73988 00100000:10000000:1.0:1787784317.905886:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787784317.910918:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787784317.910937:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787784317.910950:0:5812:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787784317.910978:0:5812:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787784317.967772:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787784317.967852:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787784317.967857:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787784318.580581:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784319.604517:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784320.629947:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784321.652735:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784322.681824:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784322.699670:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787784322.869645:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787784322.869658:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787784322.869661:0:38:0:(import.c:65:import_set_state_nolock()) 0000000015f4fcc4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784322.869675:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000015f4fcc4 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784322.869698:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000df23491c x1874627643051264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784322.869740:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df23491c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643051264:0@lo:38: 00000100:00100000:2.0:1787784322.869811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784322.869895:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051264 00000100:00100000:2.0:1787784322.869902:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051264 00000100:00100000:1.0:1787784322.870283:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f2984efa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643051136:0@lo:400: 00000100:00100000:1.0:1787784322.870329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784322.870392:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051136 00000100:00100000:1.0:1787784322.870396:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051136 00000100:00100000:1.0:1787784322.870448:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784322.870457:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1311f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:3295:x1874627643051136:12345-0@lo:400: 00000100:00100000:1.0:1787784322.870501:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1311f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:3295:x1874627643051136:12345-0@lo:400: Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784322.870509:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784322.870552:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f2984efa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643051136:0@lo:400: 00000100:00100000:2.0:1787784322.872219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784322.872229:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ea8bf5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643051264:12345-0@lo:38: 00010000:00080000:2.0:1787784322.872263:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:2.0:1787784322.872308:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xffb8d925c20ba751 00000004:00100000:2.0:1787784322.872511:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784322.874151:0:5833:0:(import.c:65:import_set_state_nolock()) 000000001ac16c8f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784322.874267:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ea8bf5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874627643051264:12345-0@lo:38: Request processed in 2035us (4453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784322.874288:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787784322.874346:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000df23491c x1874627643051264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784322.874382:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787784322.874393:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787784322.876517:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784322.876530:0:3292:0:(import.c:65:import_set_state_nolock()) 0000000015f4fcc4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784322.876549:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df23491c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643051264:0@lo:38: 00010000:00010000:0.0:1787784323.710170:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784324.726656:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784324.918929:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784324.918937:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94318875c800 from 3 10000000:01000000:3.0:1787784324.918942:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784324.919526:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784324.919542:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784324.919576:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784324.919605:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008056220b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643051392:0@lo:101: 00000100:00100000:3.0:1787784324.919683:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784324.919769:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078974672 going to sleep for 11 seconds 00000100:00100000:1.0:1787784324.923584:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051392 00000100:00100000:1.0:1787784324.923601:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051392 00000100:00100000:1.0:1787784324.923667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784324.923676:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062ed8662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5828:x1874627643051392:12345-0@lo:101: 00010000:00010000:1.0:1787784324.923694:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784324.923712:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000281ac2ea/0xffb8d925c20ba75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba758 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784324.923739:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000281ac2ea/0xffb8d925c20ba75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784324.923750:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000281ac2ea/0xffb8d925c20ba75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784324.923761:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000281ac2ea, rc 0) 00000100:00100000:1.0:1787784324.923860:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062ed8662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643051392:12345-0@lo:101: Request processed in 185us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784324.923867:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784324.925205:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008056220b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643051392:0@lo:101: 00010000:00010000:3.0:1787784324.925241:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784324.925254:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784324.925339:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008056220b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643051520:0@lo:256: 00000100:00100000:3.0:1787784324.925421:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784324.925479:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078974672 going to sleep for 11 seconds 00000100:00100000:1.0:1787784324.926138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051520 00000100:00100000:1.0:1787784324.926148:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051520 00000100:00100000:1.0:1787784324.926207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784324.926216:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa081990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643051520:12345-0@lo:256: 20000000:01000000:1.0:1787784324.926240:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787784324.926261:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787784324.926264:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787784324.926394:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa081990 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643051520:12345-0@lo:256: Request processed in 179us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784324.926402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784324.926652:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008056220b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643051520:0@lo:256: 10000000:01000000:2.0:1787784324.926715:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784324.926723:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784324.926732:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000f3af227e/0xffb8d925c20ba758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784325.748932:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784326.774632:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784327.796813:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784327.988529:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784327.988560:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000371f2876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643051776:0@lo:400: 00000100:00100000:2.0:1787784327.988647:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784327.988717:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051776 00000100:00100000:2.0:1787784327.988725:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051776 00000100:00100000:2.0:1787784327.988784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784327.988793:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dceb4134 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643051776:12345-0@lo:400: 00000100:00100000:2.0:1787784327.988859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dceb4134 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643051776:12345-0@lo:400: Request processed in 66us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784327.988866:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787784327.988916:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000371f2876 x1874627643051776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784327.988933:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000371f2876 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643051776:0@lo:400: 00000100:00100000:3.0:1787784327.989078:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9509ae7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643051648:0@lo:400: 00000100:00100000:3.0:1787784327.989113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784327.989823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051648 00000100:00100000:2.0:1787784327.989829:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051648 00000100:00100000:2.0:1787784327.989868:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784327.989875:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dee0541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3296:x1874627643051648:12345-0@lo:400: 00000100:00100000:2.0:1787784327.989922:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dee0541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3296:x1874627643051648:12345-0@lo:400: Request processed in 48us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784327.989928:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784327.990016:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9509ae7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643051648:0@lo:400: 00000020:00000080:0.0:1787784327.999035:0:6310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2d518880 20000000:00000080:0.0:1787784327.999052:0:6310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431b9537800 uarg=0000000000000000 20000000:01000000:0.0:1787784327.999096:0:6310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787784327.999103:0:6310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787784327.999107:0:6310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787784328.002349:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787784328.002729:0:6310:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787784328.012387:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784328.012703:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787784328.012762:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787784328.012841:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787784328.012860:0:6310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787784328.012875:0:6310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.012893:0:6310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.012901:0:6310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.012937:0:6310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.012951:0:6310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 11 pid: 5823 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784328.012964:0:6310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033cc3b99 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874627643051904:0@lo:104: 00000100:00100000:1.0:1787784328.013022:0:6310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784328.013089:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643051904 00000100:00100000:1.0:1787784328.013090:0:6310:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a319013 going to sleep for 11 seconds 00000100:00100000:2.0:1787784328.013097:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643051904 00000100:00100000:2.0:1787784328.013176:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784328.013184:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0269af9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:6310:x1874627643051904:12345-0@lo:104: 00010000:00010000:2.0:1787784328.013196:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784328.013253:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784328.013258:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0269af9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:6310:x1874627643051904:12345-0@lo:104: Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784328.013266:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787784328.013319:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784328.013325:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013331:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c0d75db already unused, calling callback (0000000058fa8176) 10000000:00010000:3.0:1787784328.013334:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013384:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784328.013392:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784328.013398:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787784328.013427:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013434:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784328.013450:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013456:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: 000000006c0d75db/0xffb8d925c20ba720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba727 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013473:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784328.013474:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784328.013476:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784328.013491:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784328.013503:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb276606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643052032:0@lo:103: 00000100:00100000:3.0:1787784328.013533:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784328.013565:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052032 00000100:00100000:3.0:1787784328.013568:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052032 00010000:00010000:3.0:1787784328.013585:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 12 pid: 5823 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784328.013618:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784328.013623:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008056220b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3293:x1874627643052032:12345-0@lo:103: 00010000:00010000:3.0:1787784328.013639:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784328.013644:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 12 pid: 5823 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013653:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 12 pid: 5823 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013679:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013686:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013700:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013706:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013711:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013716:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.013717:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d34b588e/0xffb8d925c20ba727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba720 expref: 12 pid: 5823 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013722:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000085a64bd2 already unused, calling callback (00000000b7ddfb4e) 00010000:00010000:3.0:1787784328.013725:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784328.013728:0:6310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033cc3b99 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874627643051904:0@lo:104: 00010000:00010000:3.0:1787784328.013741:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.013753:0:6310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013758:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.013760:0:6310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784328.013766:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784328.013766:0:6310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784328.013770:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085a64bd2/0xffb8d925c20ba766 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784328.013791:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008056220b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:3293:x1874627643052032:12345-0@lo:103: Request processed in 169us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784328.013797:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784328.013840:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb276606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643052032:0@lo:103: 00010000:00010000:0.0:1787784328.820559:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784329.854684:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784330.869584:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784331.893715:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784332.916589:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784333.109071:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643052160:0@lo:400: 00000100:00100000:2.0:1787784333.109151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784333.109215:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784333.109222:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4ddabee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643052288:0@lo:400: 00000100:00100000:2.0:1787784333.109252:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784333.109288:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052288 00000100:00100000:2.0:1787784333.109305:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052288 00000100:00100000:2.0:1787784333.109356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784333.109386:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371f2876 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643052288:12345-0@lo:400: 00000100:00100000:2.0:1787784333.109441:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371f2876 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643052288:12345-0@lo:400: Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784333.109449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787784333.109490:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4ddabee x1874627643052288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784333.109506:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4ddabee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643052288:0@lo:400: 00000100:00100000:0.0:1787784333.109579:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052160 00000100:00100000:0.0:1787784333.109584:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052160 00000100:00100000:0.0:1787784333.109622:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784333.109628:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0ed7fac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:3295:x1874627643052160:12345-0@lo:400: 00000100:00100000:0.0:1787784333.109666:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0ed7fac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:3295:x1874627643052160:12345-0@lo:400: Request processed in 39us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784333.109672:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787784333.109834:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ce0d9f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643052160:0@lo:400: 00010000:00010000:1.0:1787784333.940545:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784334.644422:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784334.644431:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94318875c800 from 1 10000000:01000000:3.0:1787784334.644436:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784334.644480:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 0000000004dd59cb/0xffb8d925c20ba76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784334.644492:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 0000000004dd59cb/0xffb8d925c20ba76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784334.644501:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 0000000004dd59cb/0xffb8d925c20ba76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784334.644523:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052416:0@lo:101: 00000100:00100000:3.0:1787784334.644588:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784334.644638:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069e0b39c going to sleep for 11 seconds 00000100:00100000:0.0:1787784334.644718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052416 00000100:00100000:0.0:1787784334.644737:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052416 00000100:00100000:0.0:1787784334.644803:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784334.644811:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f77184c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:5828:x1874627643052416:12345-0@lo:101: 00010000:00010000:0.0:1787784334.644835:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784334.644846:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dfc6d2d3/0xffb8d925c20ba774 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba76d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784334.644870:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dfc6d2d3/0xffb8d925c20ba774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784334.644880:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dfc6d2d3/0xffb8d925c20ba774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784334.644888:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dfc6d2d3, rc 0) 00000100:00100000:0.0:1787784334.644930:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f77184c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643052416:12345-0@lo:101: Request processed in 120us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784334.644936:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784334.645028:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052416:0@lo:101: 00010000:00010000:3.0:1787784334.645045:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 0000000004dd59cb/0xffb8d925c20ba76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784334.645053:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 0000000004dd59cb/0xffb8d925c20ba76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784334.645119:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052544:0@lo:501: 00000100:00100000:3.0:1787784334.645162:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784334.645186:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069e0b39c going to sleep for 11 seconds 00000100:00100000:2.0:1787784334.645556:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052544 00000100:00100000:2.0:1787784334.645561:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052544 00000100:00100000:2.0:1787784334.645597:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787784334.645605:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5f6a5b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643052544:12345-0@lo:501: 00000100:00100000:2.0:1787784334.646092:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5f6a5b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643052544:12345-0@lo:501: Request processed in 487us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784334.646101:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784334.646219:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052544:0@lo:501: 00000100:00100000:3.0:1787784334.646267:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052672:0@lo:503: 00000100:00100000:3.0:1787784334.646313:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784334.646352:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069e0b39c going to sleep for 11 seconds 00000100:00100000:0.0:1787784334.646434:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052672 00000100:00100000:0.0:1787784334.646439:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052672 00000100:00100000:0.0:1787784334.646478:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784334.646485:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c9c2177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643052672:12345-0@lo:503: 00000100:00100000:0.0:1787784334.646830:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c9c2177 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643052672:12345-0@lo:503: Request processed in 346us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784334.646837:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784334.646876:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001244bc3b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643052672:0@lo:503: 00000100:00100000:0.0:1787784334.647076:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d31811e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6667:1874627643052800:0@lo:502: 00000100:00100000:0.0:1787784334.647111:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784334.647131:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052800 00000100:00100000:0.0:1787784334.647140:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052800 00000100:00100000:0.0:1787784334.647160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784334.647165:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044291adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6667:x1874627643052800:12345-0@lo:502: 00000100:00100000:0.0:1787784334.647294:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044291adc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6667:x1874627643052800:12345-0@lo:502: Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784334.647301:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787784334.647326:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040ae52ec going to sleep for 11 seconds 00000100:00100000:0.0:1787784334.647336:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d31811e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6667:1874627643052800:0@lo:502: 00000020:01000000:0.0:1787784334.647360:0:6667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784334.647402:0:6667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784334.647405:0:6667:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787784334.647416:0:6667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94318875c800 00000020:00000080:0.0:1787784334.647419:0:6667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787784334.647464:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6667:1874627643052928:0@lo:502: 00000100:00100000:0.0:1787784334.647498:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784334.647518:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643052928 00000100:00100000:0.0:1787784334.647522:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643052928 00000100:00100000:0.0:1787784334.647538:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784334.647545:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6667:x1874627643052928:12345-0@lo:502: 00000100:00100000:0.0:1787784334.647645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6667:x1874627643052928:12345-0@lo:502: Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784334.647653:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784334.647680:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784334.647691:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6667:1874627643052928:0@lo:502: 00000020:01000000:0.0:1787784334.647708:0:6667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784334.647712:0:6667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784334.647713:0:6667:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787784334.647717:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787784334.647788:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787784334.647809:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784334.647820:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784334.647832:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784334.969932:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784335.374773:0:6676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787784335.374777:0:6676:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787784335.375115:0:6676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431b9ffe000 00000020:01000004:3.0:1787784335.375133:0:6676:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787784335.375145:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787784335.375159:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9431b5c43370) 00000020:00000080:3.0:1787784335.375175:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787784335.404025:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787784335.404727:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787784335.432892:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787784335.441973:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787784335.442011:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787784335.442064:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787784335.442091:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787784335.442994:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787784335.443007:0:6676:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784335.443020:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20ba782 00000020:01000004:2.0:1787784335.443037:0:6676:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787784335.443061:0:6676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787784335.443064:0:6676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787784335.443070:0:6676:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787784335.443075:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787784335.443095:0:6676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9431b9eccd28) 00000020:00000080:2.0:1787784335.443107:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787784335.445634:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784335.445938:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784335.445944:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787784335.448143:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784335.448158:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787784335.448885:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784335.448893:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787784335.453813:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784335.454012:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784335.454019:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787784335.458785:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787784335.458799:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787784335.529121:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784335.531598:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784335.531608:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787784335.534424:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787784335.534440:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787784335.537692:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784335.537709:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787784335.547886:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784335.548091:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787784335.548104:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787784335.549248:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787784335.549259:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787784335.638698:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784335.638950:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787784335.638957:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787784335.642635:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787784335.642658:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787784335.643160:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787784335.643264:0:6676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787784335.643271:0:6676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787784335.675478:0:6676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787784335.675536:0:6676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787784335.675540:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787784335.675542:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784335.675544:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784335.675547:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784335.675548:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784335.675550:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784335.675551:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784335.675553:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784335.675555:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784335.675557:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784335.675559:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784335.675565:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787784335.675568:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784335.675570:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784335.675572:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784335.675573:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784335.675574:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784335.675575:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784335.675576:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784335.675577:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787784335.675578:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787784335.675579:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784335.675581:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787784335.675629:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787784335.675654:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643053056:0@lo:253: 00000100:00100000:0.0:1787784335.675752:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.675807:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784335.675897:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053056 00000100:00100000:1.0:1787784335.675904:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053056 00000100:00100000:1.0:1787784335.675965:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787784335.675974:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643053056:12345-0@lo:253: 20000000:01000000:1.0:1787784335.676013:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787784335.676017:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787784335.676022:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787784335.676025:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787784335.676962:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784335.677193:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787784335.677207:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787784335.677248:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787784335.677256:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787784335.677285:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787784335.677335:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787784335.677706:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787784335.677729:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:1.0:1787784335.677731:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:1.0:1787784335.677783:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787784335.677791:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787784335.677853:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787784335.677862:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:1.0:1787784335.677894:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787784335.677903:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787784335.677932:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787784335.677981:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787784335.678702:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787784335.678720:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:1.0:1787784335.678722:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:1.0:1787784335.679898:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787784335.679917:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787784335.680018:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787784335.680027:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:1.0:1787784335.680115:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787784335.680126:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787784335.680158:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787784335.680219:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787784335.680245:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787784335.680249:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787784335.680257:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787784335.680259:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787784335.680261:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787784335.680278:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787784335.680281:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787784335.680322:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787784335.680325:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787784335.685269:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787784335.685540:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787784335.685598:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787784335.687695:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787784335.687763:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787784335.687867:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787784335.687882:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787784335.687885:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787784335.692027:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1787784335.692133:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1787784335.692183:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787784335.693683:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787784335.693733:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787784335.693790:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787784335.693804:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787784335.693806:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787784335.694820:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787784335.695083:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787784335.695126:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787784335.695221:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787784335.695242:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787784335.695264:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695296:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695304:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695310:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695318:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695361:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695420:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.695435:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196291680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053184:0@lo:104: 00000100:00100000:0.0:1787784335.695520:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784335.695588:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695609:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 12 pid: 5823 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.695618:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053312:0@lo:104: 00000100:00100000:0.0:1787784335.695641:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784335.695674:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.695682:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.695689:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196291e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053440:0@lo:104: 00000100:00100000:0.0:1787784335.695709:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.695719:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431908549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.695927:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053184 00000100:00100000:2.0:1787784335.695937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053184 00000100:00100000:2.0:1787784335.695975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053312 00000100:00100000:2.0:1787784335.695978:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053312 00000100:00100000:2.0:1787784335.695989:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053440 00000100:00100000:2.0:1787784335.695991:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053440 00000100:00100000:2.0:1787784335.696004:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784335.696015:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5826:x1874627643053184:12345-0@lo:104: 00010000:00010000:2.0:1787784335.696029:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.696130:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784335.696138:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5826:x1874627643053184:12345-0@lo:104: Request processed in 125us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.696147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784335.696167:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784335.696173:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5826:x1874627643053312:12345-0@lo:104: 00010000:00010000:2.0:1787784335.696180:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.696209:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784335.696214:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5826:x1874627643053312:12345-0@lo:104: Request processed in 42us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.696220:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784335.696232:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784335.696238:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5826:x1874627643053440:12345-0@lo:104: 00010000:00010000:2.0:1787784335.696245:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.696270:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787784335.696275:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5826:x1874627643053440:12345-0@lo:104: Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.696291:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787784335.696412:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784335.696421:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696429:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784335.696434:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696442:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784335.696459:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784335.696465:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784335.696510:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696516:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784335.696539:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696546:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181512000/0xffb8d925c20ba72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba735 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696562:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784335.696565:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696570:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513200 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784335.696573:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696580:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784335.696585:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784335.696590:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784335.696610:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696616:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784335.696622:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696634:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513200/0xffb8d925c20ba6be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696646:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784335.696650:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696655:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784335.696659:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696665:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784335.696671:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784335.696676:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784335.696688:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696694:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784335.696708:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696725:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2045400/0xffb8d925c20ba6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba6a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.696754:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784335.696756:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784335.696758:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784335.696765:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784335.696778:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643053568:0@lo:103: 00000100:00100000:1.0:1787784335.696814:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.696852:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784335.696858:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643053696:0@lo:103: 00000100:00100000:1.0:1787784335.696879:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.696906:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784335.696913:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643053824:0@lo:103: 00000100:00100000:1.0:1787784335.696949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.696979:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053568 00000100:00100000:1.0:1787784335.696984:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053568 00010000:00010000:1.0:1787784335.697005:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 13 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697019:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053696 00000100:00100000:1.0:1787784335.697022:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053696 00010000:00010000:1.0:1787784335.697032:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 14 pid: 5823 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697042:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053824 00000100:00100000:1.0:1787784335.697044:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053824 00010000:00010000:1.0:1787784335.697054:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 15 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697075:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784335.697082:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3293:x1874627643053568:12345-0@lo:103: 00010000:00010000:1.0:1787784335.697093:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784335.697099:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 15 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697108:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 15 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697124:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784335.697152:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3293:x1874627643053568:12345-0@lo:103: Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.697158:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784335.697172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784335.697178:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3293:x1874627643053696:12345-0@lo:103: 00010000:00010000:1.0:1787784335.697185:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784335.697189:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 14 pid: 5823 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697197:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 14 pid: 5823 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697207:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784335.697228:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3293:x1874627643053696:12345-0@lo:103: Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.697233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784335.697245:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784335.697257:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3296:x1874627643053824:12345-0@lo:103: 00010000:00010000:1.0:1787784335.697264:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784335.697270:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 13 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697278:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 13 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697306:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697315:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697330:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697337:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697345:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697351:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697356:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784335.697361:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697416:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697432:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697443:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784335.697470:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3296:x1874627643053824:12345-0@lo:103: Request processed in 214us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.697477:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784335.697520:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643053824:0@lo:103: 00000100:00100000:1.0:1787784335.697546:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643053696:0@lo:103: 00000100:00100000:1.0:1787784335.697553:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643053568:0@lo:103: 00010000:00010000:1.0:1787784335.697582:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0000/0xffb8d925c20ba735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba72e expref: 12 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697594:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196291680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053184:0@lo:104: 00010000:00010000:1.0:1787784335.697604:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031a00/0xffb8d925c20ba6c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba6be expref: 11 pid: 5823 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697611:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053312:0@lo:104: 00010000:00010000:1.0:1787784335.697619:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba6a2 expref: 10 pid: 5825 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.697626:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196291e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874627643053440:0@lo:104: 00010000:00010000:1.0:1787784335.697641:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697650:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697665:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.697670:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030a00/0xffb8d925c20ba790 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784335.697684:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787784335.768720:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:6676:x1874627643053056:12345-0@lo:253: Request processed in 92737us (92958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.768851:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643053056:0@lo:253: 10000000:01000000:0.0:1787784335.768866:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787784335.768869:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784335.768871:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787784335.768872:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784335.768874:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787784335.768875:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784335.768876:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784335.768877:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784335.768879:0:6676:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787784335.768881:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784335.768882:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787784335.768906:0:6676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431b9ffe000 from lustre-OST0000 10000000:01000000:0.0:1787784335.768931:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787784335.768934:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784335.768940:0:6676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431857819b8 local copy 10000000:01000000:0.0:1787784335.768973:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787784335.769009:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.769020:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.769029:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.769047:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643053952:0@lo:101: 00000100:00100000:0.0:1787784335.769085:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.769137:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431908546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.769584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784335.769621:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643053952 00000100:00100000:2.0:1787784335.769635:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643053952 00000100:00100000:2.0:1787784335.769672:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784335.769682:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:6676:x1874627643053952:12345-0@lo:101: 00010000:00010000:2.0:1787784335.769696:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784335.769709:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2045200/0xffb8d925c20ba79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba797 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.769820:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2045200/0xffb8d925c20ba79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba797 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.769834:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2045200/0xffb8d925c20ba79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba797 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.769843:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2045200, rc 0) 00000100:00100000:2.0:1787784335.769882:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:6676:x1874627643053952:12345-0@lo:101: Request processed in 201us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.769888:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784335.770033:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643053952:0@lo:101: 00010000:00010000:0.0:1787784335.770047:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.770056:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.770168:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054080:0@lo:501: 00000100:00100000:0.0:1787784335.770197:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.770225:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431908546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.770281:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054080 00000100:00100000:2.0:1787784335.770346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054080 00000100:00100000:2.0:1787784335.770442:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787784335.770451:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:6676:x1874627643054080:12345-0@lo:501: 00000100:00100000:2.0:1787784335.770679:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:6676:x1874627643054080:12345-0@lo:501: Request processed in 229us (481us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784335.770686:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784335.770907:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054080:0@lo:501: 10000000:01000000:0.0:1787784335.770925:0:6676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787784335.770953:0:6676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787784335.770960:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.770981:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.770988:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.771012:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787784335.771034:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431b9ffe000 10000000:01000000:0.0:1787784335.771040:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787784335.771046:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9431857819b8 10000000:01000000:0.0:1787784335.771049:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787784335.771053:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9431857819b8 from 1 10000000:01000000:0.0:1787784335.771056:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787784335.771077:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.771085:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.771094:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.771109:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054208:0@lo:101: 00000100:00100000:0.0:1787784335.771139:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784335.771178:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784335.771185:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771192:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784335.771196:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771205:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784335.771211:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784335.771216:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784335.771237:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771243:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784335.771261:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771268:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba79e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771305:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784335.771308:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784335.771309:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784335.771322:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643054336:0@lo:103: 00000100:00100000:1.0:1787784335.771351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.771432:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054336 00000100:00100000:1.0:1787784335.771437:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054336 00000100:00100000:1.0:1787784335.771475:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784335.771483:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:3296:x1874627643054336:12345-0@lo:103: 00010000:00010000:1.0:1787784335.771495:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784335.771509:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2045200/0xffb8d925c20ba79e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba797 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.771522:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784335.771552:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:3296:x1874627643054336:12345-0@lo:103: Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.771558:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784335.771588:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643054336:0@lo:103: 00000100:00100000:0.0:1787784335.771838:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784335.771964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054208 00000100:00100000:3.0:1787784335.771969:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054208 00000100:00100000:3.0:1787784335.771994:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784335.772001:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:6676:x1874627643054208:12345-0@lo:101: 00010000:00010000:3.0:1787784335.772011:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784335.772025:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181512800/0xffb8d925c20ba7ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba7a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.772045:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181512800/0xffb8d925c20ba7ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba7a5 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.772056:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181512800/0xffb8d925c20ba7ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7a5 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.772062:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512800, rc 0) 00000100:00100000:3.0:1787784335.772105:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:6676:x1874627643054208:12345-0@lo:101: Request processed in 105us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784335.772111:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784335.772196:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054208:0@lo:101: 00010000:00010000:0.0:1787784335.772209:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772231:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784335.772249:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787784335.772267:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772276:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784335.772443:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787784335.772449:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787784335.772454:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787784335.772457:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787784335.772478:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772486:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772493:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.772509:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054464:0@lo:101: 00000100:00100000:0.0:1787784335.772540:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.772606:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.772680:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054464 00000100:00100000:2.0:1787784335.772685:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054464 00000100:00100000:0.0:1787784335.772906:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784335.772915:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+10:6676:x1874627643054464:12345-0@lo:101: 00010000:00010000:0.0:1787784335.772933:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784335.772944:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba7b3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772960:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772970:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.772977:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030600, rc 0) 00000100:00100000:0.0:1787784335.773019:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054464:12345-0@lo:101: Request processed in 106us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.773025:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784335.773087:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054464:0@lo:101: 00010000:00010000:1.0:1787784335.773099:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.773106:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784335.773202:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054592:0@lo:501: 00000100:00100000:1.0:1787784335.773240:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.773496:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186e339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784335.773527:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054592 00000100:00100000:3.0:1787784335.773532:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054592 00000100:00100000:3.0:1787784335.773555:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784335.773561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054592:12345-0@lo:501: 00000100:00100000:3.0:1787784335.774022:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054592:12345-0@lo:501: Request processed in 459us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784335.774030:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787784335.774098:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054592:0@lo:501: 00000100:00100000:1.0:1787784335.774140:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054720:0@lo:503: 00000100:00100000:1.0:1787784335.774180:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.774202:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186e339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.774252:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054720 00000100:00100000:2.0:1787784335.774257:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054720 00000100:00100000:0.0:1787784335.774444:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784335.774452:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054720:12345-0@lo:503: 00000100:00100000:0.0:1787784335.774630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054720:12345-0@lo:503: Request processed in 179us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.774637:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784335.774722:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054720:0@lo:503: 00000040:00080000:1.0:1787784335.775094:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784335.775156:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054848:0@lo:502: 00000100:00100000:1.0:1787784335.775193:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.775567:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186e339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.775634:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054848 00000100:00100000:2.0:1787784335.775640:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054848 00000100:00100000:2.0:1787784335.775675:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784335.775683:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054848:12345-0@lo:502: 00000100:00100000:2.0:1787784335.775984:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054848:12345-0@lo:502: Request processed in 302us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.775992:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784335.776081:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054848:0@lo:502: 00000040:00080000:1.0:1787784335.776458:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787784335.776515:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787784335.776554:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787784335.776604:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787784335.776641:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787784335.776672:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787784335.776706:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054976:0@lo:502: 00000100:00100000:1.0:1787784335.776836:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.776877:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186e339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784335.776954:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643054976 00000100:00100000:3.0:1787784335.776967:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643054976 00000100:00100000:3.0:1787784335.776998:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784335.777006:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054976:12345-0@lo:502: 00000100:00100000:3.0:1787784335.777179:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643054976:12345-0@lo:502: Request processed in 173us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784335.777186:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784335.777411:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643054976:0@lo:502: 00000040:00080000:1.0:1787784335.777509:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787784335.777522:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787784335.778163:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784335.778171:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787784335.778184:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784335.778186:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787784335.778193:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784335.778209:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff943185783370) 00000020:00000080:1.0:1787784335.778228:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787784335.778233:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787784335.778595:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b9ffe000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787784335.778604:0:6693:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787784335.778613:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20ba7c8 00010000:00010000:2.0:1787784335.786509:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787784335.787203:0:6693:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787784335.792885:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787784335.793228:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787784335.805080:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787784335.807257:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787784335.810009:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787784335.810023:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784335.810029:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784335.810031:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787784335.810034:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784335.810039:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784335.810040:0:6693:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787784335.810043:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787784335.810045:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787784335.810100:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784335.810103:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784335.810105:0:6693:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787784335.810107:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787784335.812324:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787784335.812392:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787784335.812415:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.812429:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784335.812438:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9ffe000 from 1 10000000:01000000:2.0:1787784335.812440:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784335.812477:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.812486:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.812497:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784335.812542:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055104:0@lo:101: 00000100:00100000:2.0:1787784335.812607:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.812653:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784335.812748:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055104 00000100:00100000:1.0:1787784335.812756:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055104 00000100:00100000:1.0:1787784335.812798:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784335.812808:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:6676:x1874627643055104:12345-0@lo:101: 00010000:00010000:1.0:1787784335.812822:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784335.812836:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba7cf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.812859:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.812869:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784335.812877:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784335.812919:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055104:12345-0@lo:101: Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.812926:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784335.813238:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055104:0@lo:101: 00010000:00010000:2.0:1787784335.813255:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.813264:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784335.813555:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055232:0@lo:501: 00000100:00100000:2.0:1787784335.813590:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.813626:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784335.813681:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055232 00000100:00100000:1.0:1787784335.813685:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055232 00000100:00100000:1.0:1787784335.813716:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787784335.813724:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055232:12345-0@lo:501: 00000100:00100000:1.0:1787784335.813999:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055232:12345-0@lo:501: Request processed in 275us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784335.814016:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784335.814105:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055232:0@lo:501: 00000100:00100000:2.0:1787784335.814134:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055360:0@lo:503: 00000100:00100000:2.0:1787784335.814171:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.814187:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.814204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055360 00000100:00100000:2.0:1787784335.814207:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055360 00000100:00100000:2.0:1787784335.814275:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784335.814293:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055360:12345-0@lo:503: 00000100:00100000:2.0:1787784335.814513:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055360:12345-0@lo:503: Request processed in 231us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.814521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784335.819784:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055360:0@lo:503: 00000040:00080000:2.0:1787784335.820835:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784335.821512:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055488:0@lo:502: 00000100:00100000:2.0:1787784335.821688:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.823014:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318691f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784335.830679:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055488 00000100:00100000:1.0:1787784335.830697:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055488 00000100:00100000:0.0:1787784335.831044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784335.831056:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055488:12345-0@lo:502: 00000100:00100000:0.0:1787784335.831394:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055488:12345-0@lo:502: Request processed in 341us (9706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.831403:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784335.833798:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055488:0@lo:502: 00000040:00080000:2.0:1787784335.834234:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787784335.834530:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787784335.834581:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055616:0@lo:502: 00000100:00100000:2.0:1787784335.834925:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.835075:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784335.835133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055616 00000100:00100000:0.0:1787784335.835139:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055616 00000100:00100000:0.0:1787784335.835262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784335.835271:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055616:12345-0@lo:502: 00000100:00100000:0.0:1787784335.835526:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055616:12345-0@lo:502: Request processed in 255us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.835533:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784335.835628:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055616:0@lo:502: 00000040:00080000:1.0:1787784335.835762:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787784335.835774:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787784335.838573:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784335.838589:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784335.838592:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787784335.838601:0:6697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b9ffe000 00000020:00000080:1.0:1787784335.838603:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784335.838638:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784335.838642:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784335.838643:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787784335.838647:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787784335.838891:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787784335.838924:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784335.838952:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.838963:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784335.839009:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787784335.839012:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431b9ffe000 10000000:01000000:3.0:1787784335.839015:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431b9ffe000 10000000:01000000:3.0:1787784335.839026:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784335.839032:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431b9ffe000 from 1 10000000:01000000:3.0:1787784335.839036:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787784335.839075:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.839084:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.839095:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784335.839123:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055744:0@lo:101: 00000100:00100000:3.0:1787784335.839194:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784335.839962:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.840116:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055744 00000100:00100000:2.0:1787784335.840124:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055744 00000100:00100000:0.0:1787784335.840195:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784335.840208:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643055744:12345-0@lo:101: 00010000:00010000:0.0:1787784335.840224:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784335.840241:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba7dd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.840269:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.840280:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.840456:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180031800, rc 0) 00000100:00100000:0.0:1787784335.840524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643055744:12345-0@lo:101: Request processed in 319us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.840532:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787784335.840853:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055744:0@lo:101: 00010000:00010000:3.0:1787784335.840874:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784335.840885:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784335.841023:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055872:0@lo:501: 00000100:00100000:3.0:1787784335.841059:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784335.841128:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.841304:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643055872 00000100:00100000:2.0:1787784335.841310:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643055872 00000100:00100000:0.0:1787784335.841490:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784335.841499:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643055872:12345-0@lo:501: 00000100:00100000:0.0:1787784335.841923:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643055872:12345-0@lo:501: Request processed in 424us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.841931:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784335.842248:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643055872:0@lo:501: 00000100:00100000:3.0:1787784335.842351:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056000:0@lo:503: 00000100:00100000:3.0:1787784335.842527:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784335.842617:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784335.842712:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056000 00000100:00100000:2.0:1787784335.842717:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056000 00000100:00100000:2.0:1787784335.842790:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784335.842800:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056000:12345-0@lo:503: 00000100:00100000:2.0:1787784335.842997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056000:12345-0@lo:503: Request processed in 199us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.843004:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784335.843072:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056000:0@lo:503: 00000040:00080000:3.0:1787784335.843424:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784335.843495:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056128:0@lo:502: 00000100:00100000:3.0:1787784335.843535:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784335.844009:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784335.844100:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056128 00000100:00100000:0.0:1787784335.844105:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056128 00000100:00100000:0.0:1787784335.844134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784335.844141:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056128:12345-0@lo:502: 00000100:00100000:0.0:1787784335.844358:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056128:12345-0@lo:502: Request processed in 217us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.844392:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787784335.844541:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056128:0@lo:502: 00000040:00080000:3.0:1787784335.844879:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787784335.844931:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787784335.844965:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787784335.845013:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787784335.845048:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787784335.845094:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787784335.845127:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787784335.845162:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787784335.845224:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787784335.845261:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787784335.845310:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787784335.845357:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787784335.845427:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787784335.845459:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787784335.845505:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787784335.845539:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787784335.845570:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787784335.845615:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787784335.845650:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787784335.845686:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787784335.845763:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787784335.845801:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787784335.845834:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787784335.845881:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787784335.845937:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787784335.845969:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787784335.846018:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787784335.846052:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787784335.846098:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056256:0@lo:502: 00000100:00100000:3.0:1787784335.846168:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784335.846216:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784335.846470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056256 00000100:00100000:0.0:1787784335.846477:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056256 00000100:00100000:0.0:1787784335.846511:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784335.846519:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056256:12345-0@lo:502: 00000100:00100000:0.0:1787784335.846745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056256:12345-0@lo:502: Request processed in 216us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.846753:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787784335.846905:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056256:0@lo:502: 00000040:00080000:3.0:1787784335.846975:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787784335.846985:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787784335.859942:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787784335.860218:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9431b5c44d28) 00000020:00000080:3.0:1787784335.860241:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787784335.861817:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b9ffe000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787784335.861827:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b9ffe000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787784335.861830:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9ffe000 3 00010000:00080000:3.0:1787784335.861868:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431bf181000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1787784335.867922:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787784335.868097:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784335.868140:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784335.868153:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xffb8d925c20ba7f2 00000100:00080000:0.0:1787784335.868164:0:6698:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784335.868170:0:6698:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9431bf181000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784335.868217:0:6698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431962930c0 x1874627643056384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784335.868238:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784335.870490:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643056384:0@lo:38: 00000100:00100000:2.0:1787784335.870591:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.870696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056384 00000100:00100000:2.0:1787784335.870704:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056384 00000100:00100000:2.0:1787784335.870746:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784335.870756:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643056384:12345-0@lo:38: 00010000:00080000:2.0:1787784335.870807:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:2.0:1787784335.870845:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xffb8d925c20ba7f9 00000004:00100000:2.0:1787784335.870862:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784335.870900:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9431ac7a7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784335.870957:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874627643056384:12345-0@lo:38: Request processed in 200us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.870964:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784335.871009:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431962930c0 x1874627643056384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784335.871020:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784335.871028:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787784335.871037:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784335.871043:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784335.871045:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf181000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784335.871050:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643056384:0@lo:38: 00000100:00100000:0.0:1787784335.871478:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784335.871494:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643056512:0@lo:400: 00000100:00100000:0.0:1787784335.871685:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784335.872035:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056512 00000100:00100000:2.0:1787784335.872042:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056512 00000100:00100000:2.0:1787784335.872083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784335.872094:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643056512:12345-0@lo:400: 00000100:00100000:2.0:1787784335.872142:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643056512:12345-0@lo:400: Request processed in 52us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.872148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787784335.872404:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431962921c0 x1874627643056512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784335.872418:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643056512:0@lo:400: 00000040:00080000:0.0:1787784335.872586:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787784335.881149:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787784335.881197:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784335.881216:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784335.881256:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784335.881745:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784335.881748:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784335.881749:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784335.881750:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784335.881752:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784335.881753:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784335.881754:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784335.881756:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784335.881757:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784335.881759:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784335.881760:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784335.881764:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787784335.881766:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784335.881768:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784335.881769:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784335.881770:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784335.881771:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784335.881772:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784335.881774:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784335.881775:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784335.881776:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784335.881777:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784335.881778:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784335.881815:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787784335.881843:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056640:0@lo:253: 00000100:00100000:2.0:1787784335.881929:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.882057:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056640 00000100:00100000:0.0:1787784335.882066:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056640 00000100:00100000:2.0:1787784335.882581:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431891323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784335.888470:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784335.888495:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6676:x1874627643056640:12345-0@lo:253: 20000000:01000000:0.0:1787784335.888700:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787784335.888716:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784335.922802:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784335.922821:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787784335.922929:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784335.922934:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784335.922955:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.922973:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.922982:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923020:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923035:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 13 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.923048:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643056768:0@lo:104: 00000100:00100000:0.0:1787784335.923115:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784335.923165:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf15f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784335.923189:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056768 00000100:00100000:0.0:1787784335.923197:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056768 00000100:00100000:0.0:1787784335.923240:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784335.923262:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643056768:12345-0@lo:104: 00010000:00010000:0.0:1787784335.923274:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923336:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784335.923342:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643056768:12345-0@lo:104: Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.923349:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787784335.923409:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784335.923416:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923424:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784335.923429:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923437:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784335.923444:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784335.923450:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784335.923482:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923489:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784335.923505:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923524:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba75f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.923542:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784335.923545:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784335.923546:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784335.923568:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643056896:0@lo:103: 00000100:00100000:0.0:1787784335.923603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784335.924108:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643056768:0@lo:104: 00010000:00010000:1.0:1787784335.924131:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.925036:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643056896 00000100:00100000:0.0:1787784335.925046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643056896 00010000:00010000:0.0:1787784335.925078:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 14 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.925106:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784335.925115:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3294:x1874627643056896:12345-0@lo:103: 00010000:00010000:0.0:1787784335.925128:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784335.925133:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 14 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925144:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 14 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925161:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1000/0xffb8d925c20ba75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba758 expref: 14 pid: 5826 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925176:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925203:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784335.925218:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002284384s 00010000:00010000:0.0:1787784335.925222:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925229:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925236:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925243:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925250:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784335.925254:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925262:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925277:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925301:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784335.925348:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3294:x1874627643056896:12345-0@lo:103: Request processed in 234us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784335.925355:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787784335.925467:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925476:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784335.925483:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030000/0xffb8d925c20ba800 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784335.925515:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643056896:0@lo:103: 00000100:00100000:2.0:1787784335.939274:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:6676:x1874627643056640:12345-0@lo:253: Request processed in 50780us (57334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784335.939342:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784335.939465:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6676:1874627643056640:0@lo:253: 10000000:01000000:3.0:1787784335.939482:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787784335.939485:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784335.939487:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787784335.939488:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784335.939489:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784335.939491:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784335.939492:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784335.939493:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784335.939495:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787784335.939496:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787784335.939497:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784335.939498:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787784335.939512:0:6676:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787784335.949500:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784335.950149:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784335.951490:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784335.951934:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784335.953269:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784335.957697:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787784335.959585:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787784335.993095:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787784336.340431:0:6676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787784336.340439:0:6676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787784336.340470:0:6676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784336.340533:0:6676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784336.340554:0:6676:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787784336.340586:0:6676:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787784337.016111:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784338.037443:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784339.062972:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784340.084748:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784341.118767:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784341.305032:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643057280:0@lo:400: 00000100:00100000:3.0:1787784341.305112:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784341.306743:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643057024:0@lo:400: 00000100:00100000:1.0:1787784341.306829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784341.306885:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784341.306892:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643057152:0@lo:400: 00000100:00100000:1.0:1787784341.306920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784341.306985:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057280 00000100:00100000:1.0:1787784341.307014:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057280 00000100:00100000:1.0:1787784341.307068:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057152 00000100:00100000:1.0:1787784341.307071:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057152 00000100:00100000:1.0:1787784341.307145:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784341.307155:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643057280:12345-0@lo:400: 00000100:00100000:1.0:1787784341.307214:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643057280:12345-0@lo:400: Request processed in 60us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784341.307221:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784341.307250:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784341.307257:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643057152:12345-0@lo:400: 00000100:00100000:1.0:1787784341.307291:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643057152:12345-0@lo:400: Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784341.307297:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787784341.307347:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a6580 x1874627643057280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784341.307361:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643057280:0@lo:400: 00010000:00080000:1.0:1787784341.307430:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a4b40 x1874627643057152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784341.307440:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643057152:0@lo:400: 00000100:00100000:3.0:1787784341.307670:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057024 00000100:00100000:3.0:1787784341.307675:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057024 00000100:00100000:3.0:1787784341.307721:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787784341.307729:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3295:x1874627643057024:12345-0@lo:400: 00000100:00100000:3.0:1787784341.307770:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3295:x1874627643057024:12345-0@lo:400: Request processed in 42us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784341.307776:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787784341.307815:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784341.309839:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643057024:0@lo:400: 00010000:00010000:1.0:1787784342.139105:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784342.836523:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787784342.836531:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94318875c800 from 21 10000000:01000000:0.0:1787784342.836537:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784342.836583:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.836594:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.836606:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784342.836629:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057408:0@lo:101: 00000100:00100000:0.0:1787784342.836706:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.836773:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784342.837339:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057408 00000100:00100000:2.0:1787784342.837348:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057408 00000100:00100000:2.0:1787784342.837436:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787784342.837446:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643057408:12345-0@lo:101: 00010000:00010000:2.0:1787784342.837460:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784342.837474:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba807 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.837499:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.837509:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.837518:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2044800, rc 0) 00000100:00100000:2.0:1787784342.837564:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643057408:12345-0@lo:101: Request processed in 119us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784342.837572:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784342.838694:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057408:0@lo:101: 00010000:00010000:0.0:1787784342.838720:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.838747:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784342.838822:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057536:0@lo:501: 00000100:00100000:0.0:1787784342.838867:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.838911:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784342.842817:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057536 00000100:00100000:2.0:1787784342.842833:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057536 00000100:00100000:2.0:1787784342.842925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787784342.842934:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643057536:12345-0@lo:501: 00000100:00100000:2.0:1787784342.843401:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643057536:12345-0@lo:501: Request processed in 467us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784342.843410:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787784342.852036:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057536:0@lo:501: 00000100:00100000:1.0:1787784342.852105:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057664:0@lo:503: 00000100:00100000:1.0:1787784342.852188:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784342.852259:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431922f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784342.852274:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057664 00000100:00100000:2.0:1787784342.852281:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057664 00000100:00100000:2.0:1787784342.852334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784342.852345:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643057664:12345-0@lo:503: 00000100:00100000:2.0:1787784342.852723:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643057664:12345-0@lo:503: Request processed in 379us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784342.852731:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787784342.852840:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643057664:0@lo:503: 00000100:00100000:0.0:1787784342.853883:0:6982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196291680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6982:1874627643057792:0@lo:502: 00000100:00100000:0.0:1787784342.853949:0:6982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.853994:0:6982:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784342.854064:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057792 00000100:00100000:2.0:1787784342.854070:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057792 00000100:00100000:2.0:1787784342.854112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787784342.854121:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6982:x1874627643057792:12345-0@lo:502: 00000100:00100000:2.0:1787784342.854410:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6982:x1874627643057792:12345-0@lo:502: Request processed in 289us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784342.854418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784342.855401:0:6982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196291680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6982:1874627643057792:0@lo:502: 00000100:00100000:1.0:1787784342.855477:0:6982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6982:1874627643057920:0@lo:502: 00000100:00100000:1.0:1787784342.855535:0:6982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784342.855562:0:6982:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431922f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784342.856597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643057920 00000100:00100000:0.0:1787784342.856608:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643057920 00000100:00100000:0.0:1787784342.856662:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787784342.856680:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6982:x1874627643057920:12345-0@lo:502: 00000100:00100000:0.0:1787784342.856925:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:6982:x1874627643057920:12345-0@lo:502: Request processed in 255us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.856933:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784342.857328:0:6982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6982:1874627643057920:0@lo:502: 00000040:00080000:1.0:1787784342.857359:0:6982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787784342.857457:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787784342.857474:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784342.857483:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.857493:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784342.857502:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787784342.857511:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94318875c800 from 4 10000000:01000000:2.0:1787784342.857514:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787784342.857543:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.857551:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784342.857560:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784342.857577:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197015680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058048:0@lo:101: 00000100:00100000:2.0:1787784342.857611:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784342.857645:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf15fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784342.858312:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058048 00000100:00100000:1.0:1787784342.858318:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058048 00000100:00100000:1.0:1787784342.858399:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784342.858409:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643058048:12345-0@lo:101: 00010000:00010000:1.0:1787784342.858421:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784342.858435:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba815 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.858457:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.858467:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.858474:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784342.858513:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643058048:12345-0@lo:101: Request processed in 107us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784342.858519:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784342.858552:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197015680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058048:0@lo:101: 00010000:00010000:1.0:1787784342.858566:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.858585:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784342.858633:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058176:0@lo:256: 00000100:00100000:1.0:1787784342.858664:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784342.858695:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431922f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784342.858819:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058176 00000100:00100000:3.0:1787784342.858824:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058176 00000100:00100000:3.0:1787784342.858857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787784342.858864:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643058176:12345-0@lo:256: 20000000:01000000:3.0:1787784342.858878:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787784342.858894:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787784342.858896:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787784342.858970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643058176:12345-0@lo:256: Request processed in 106us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784342.858976:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784342.859620:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058176:0@lo:256: 10000000:01000000:1.0:1787784342.859667:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784342.859687:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859706:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784342.859716:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787784342.859718:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787784342.859721:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787784342.859748:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859757:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859766:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784342.859781:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058304:0@lo:101: 00000100:00100000:1.0:1787784342.859823:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784342.859849:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784342.859867:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058304 00000100:00100000:1.0:1787784342.859871:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058304 00000100:00100000:1.0:1787784342.859908:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784342.859916:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643058304:12345-0@lo:101: 00010000:00010000:1.0:1787784342.859926:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784342.859937:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba823 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859954:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859963:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.859971:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784342.860000:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643058304:12345-0@lo:101: Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784342.860006:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784342.860032:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058304:0@lo:101: 00010000:00010000:1.0:1787784342.860042:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784342.860050:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784342.860089:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058432:0@lo:501: 00000100:00100000:1.0:1787784342.860120:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784342.860133:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784342.860143:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058432 00000100:00100000:1.0:1787784342.860146:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058432 00000100:00100000:1.0:1787784342.860160:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784342.860165:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643058432:12345-0@lo:501: 00000100:00100000:1.0:1787784342.863054:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643058432:12345-0@lo:501: Request processed in 2879us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784342.863068:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784342.863138:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058432:0@lo:501: 00000100:00100000:1.0:1787784342.863193:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058560:0@lo:503: 00000100:00100000:0.0:1787784342.874324:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.874417:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784342.874440:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058560 00000100:00100000:1.0:1787784342.874449:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058560 00000100:00100000:1.0:1787784342.874501:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784342.874511:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643058560:12345-0@lo:503: 00000100:00100000:1.0:1787784342.874916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643058560:12345-0@lo:503: Request processed in 405us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784342.874924:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784342.875663:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643058560:0@lo:503: 00000100:00100000:3.0:1787784342.907882:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6983:1874627643058688:0@lo:502: 00000100:00100000:3.0:1787784342.907976:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784342.908030:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784342.908741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058688 00000100:00100000:1.0:1787784342.908749:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058688 00000100:00100000:1.0:1787784342.908790:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784342.908798:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:6983:x1874627643058688:12345-0@lo:502: 00000100:00100000:1.0:1787784342.909088:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:6983:x1874627643058688:12345-0@lo:502: Request processed in 289us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784342.909096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784342.910618:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6983:1874627643058688:0@lo:502: 00000020:01000000:3.0:1787784342.910661:0:6983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787784342.910682:0:6983:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787784342.910690:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784342.910701:0:6983:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787784342.910707:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787784342.910711:0:6983:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:3.0:1787784342.910736:0:6983:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787784342.910739:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787784342.910767:0:6983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9431908f8000) 00000020:00000080:3.0:1787784342.910788:0:6983:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787784342.910794:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787784342.910871:0:6983:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787784342.910876:0:6983:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787784342.910882:0:6983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba838 00010000:00080000:3.0:1787784342.910910:0:6983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431b42bf000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1787784342.911137:0:6983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787784342.971833:0:6983:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787784342.971855:0:6983:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787784342.972588:0:6983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784342.972785:0:6983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784342.972829:0:6983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787784342.972883:0:6983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787784342.973414:0:6986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784342.973420:0:6986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787784342.977068:0:6983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784342.977082:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784342.977121:0:6983:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787784342.977142:0:6983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20ba83f 00000100:00080000:0.0:1787784342.977152:0:6983:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784342.977159:0:6983:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431b42bf000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784342.977194:0:6983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff943196293c00 x1874627643058816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784342.977237:0:6983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787784342.977325:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643058944:0@lo:400: 00000100:00100000:0.0:1787784342.977407:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.977474:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643059072:0@lo:400: 00000100:00100000:0.0:1787784342.977501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.977539:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058944 00000100:00100000:0.0:1787784342.977545:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058944 00000100:00100000:0.0:1787784342.977579:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059072 00000100:00100000:0.0:1787784342.977582:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059072 00000100:00100000:0.0:1787784342.977597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784342.977605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643058944:12345-0@lo:400: 00000100:00100000:0.0:1787784342.977650:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643058944:12345-0@lo:400: Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.977658:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784342.977687:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784342.977694:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643059072:12345-0@lo:400: 00000100:00100000:0.0:1787784342.977726:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643059072:12345-0@lo:400: Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.977732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787784342.977768:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196292580 x1874627643059072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784342.977782:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643059072:0@lo:400: 00010000:00080000:0.0:1787784342.977807:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196290b40 x1874627643058944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784342.977817:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643058944:0@lo:400: 00000020:01000000:0.0:1787784342.977879:0:6983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784342.977884:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784342.977886:0:6983:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787784342.977889:0:6983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784342.977894:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784342.977896:0:6983:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787784342.977899:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784342.977901:0:6983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787784342.977923:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6983:1874627643059200:0@lo:502: 00000100:00100000:0.0:1787784342.977963:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.977989:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059200 00000100:00100000:0.0:1787784342.977992:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059200 00000100:00100000:0.0:1787784342.978016:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784342.978022:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:6983:x1874627643059200:12345-0@lo:502: 00000100:00100000:0.0:1787784342.978235:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:6983:x1874627643059200:12345-0@lo:502: Request processed in 213us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.978242:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784342.978277:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784342.978289:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:6983:1874627643059200:0@lo:502: 00000020:01000000:0.0:1787784342.978308:0:6983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784342.978312:0:6983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784342.978314:0:6983:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787784342.978316:0:6983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787784342.978383:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787784342.978401:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787784342.978410:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978421:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784342.978436:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787784342.978438:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431857819b8 from 1 10000000:01000000:0.0:1787784342.978441:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787784342.978465:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978473:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978481:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784342.978493:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643059328:0@lo:101: 00000100:00100000:0.0:1787784342.978518:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.978533:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784342.978546:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059328 00000100:00100000:0.0:1787784342.978549:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059328 00000100:00100000:0.0:1787784342.978568:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784342.978574:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643059328:12345-0@lo:101: 00010000:00010000:0.0:1787784342.978583:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784342.978594:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba846 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978614:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978626:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978645:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180031a00, rc 0) 00000100:00100000:0.0:1787784342.978687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643059328:12345-0@lo:101: Request processed in 97us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.978693:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784342.978720:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643059328:0@lo:101: 00010000:00010000:0.0:1787784342.978732:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.978740:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784342.978776:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643059456:0@lo:501: 00000100:00100000:0.0:1787784342.978800:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.978811:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784342.978823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059456 00000100:00100000:0.0:1787784342.978826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059456 00000100:00100000:0.0:1787784342.978845:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784342.978852:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643059456:12345-0@lo:501: 00000100:00100000:0.0:1787784342.979036:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643059456:12345-0@lo:501: Request processed in 183us (234us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784342.979043:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784342.979069:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643059456:0@lo:501: 10000000:01000000:0.0:1787784342.979086:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787784342.979091:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784342.979109:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784342.979395:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643058816:0@lo:8: 00000100:00100000:2.0:1787784342.979436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784342.979569:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643058816 00000100:00100000:0.0:1787784342.979574:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643058816 00000100:00100000:0.0:1787784342.979591:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784342.979596:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643058816:12345-0@lo:8: 00010000:00080000:0.0:1787784342.979618:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1787784342.979641:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20ba854 00002000:00100000:0.0:1787784342.979696:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9431bed66000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787784342.979701:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787784342.979705:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787784342.979810:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784342.979955:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784342.979981:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9431bed67800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784342.980031:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643058816:12345-0@lo:8: Request processed in 433us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784342.980039:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787784342.980074:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196293c00 x1874627643058816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784342.980084:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784342.980090:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787784342.980098:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787784342.980104:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787784342.980107:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42bf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787784342.980130:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787784342.980136:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643058816:0@lo:8: 00000004:00080000:2.0:1787784342.980347:0:6986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787784342.980468:0:6986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 157807102034ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787784343.038581:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787784343.038861:0:6987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787784343.038904:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059712:0@lo:7: 00000100:00100000:1.0:1787784343.038976:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784343.039030:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784343.039091:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643059584:0@lo:13: 00000100:00100000:3.0:1787784343.039140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784343.039241:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059584 00000100:00100000:1.0:1787784343.039249:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059584 00000100:00100000:1.0:1787784343.039308:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784343.039317:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643059584:12345-0@lo:13: 00002000:00000024:1.0:1787784343.039347:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787784343.039408:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643059584:12345-0@lo:13: Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784343.039415:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787784343.039459:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197116d00 x1874627643059584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784343.039478:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643059584:0@lo:13: 00000100:00080000:3.0:1787784343.039609:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784343.039785:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059712 00000100:00100000:2.0:1787784343.039789:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059712 00000100:00100000:2.0:1787784343.039820:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784343.039826:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6987:x1874627643059712:12345-0@lo:7: 00002000:00080000:3.0:1787784343.054893:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787784343.054902:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787784343.057466:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6987:x1874627643059712:12345-0@lo:7: Request processed in 17626us (18476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784343.057491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784343.058361:0:6987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197115e00 x1874627643059712/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784343.058390:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059712:0@lo:7: 00000004:00080000:1.0:1787784343.058405:0:6987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787784343.058454:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059840:0@lo:5: 00000100:00100000:1.0:1787784343.058515:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784343.058580:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784343.058662:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059840 00000100:00100000:3.0:1787784343.058679:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059840 00000100:00100000:3.0:1787784343.058733:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784343.058742:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6987:x1874627643059840:12345-0@lo:5: 00002000:00080000:3.0:1787784343.058773:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787784343.058776:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787784343.059103:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6987:x1874627643059840:12345-0@lo:5: Request processed in 361us (586us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787784343.059110:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784343.059188:0:6987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197115e00 x1874627643059840/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784343.059200:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059840:0@lo:5: 00000004:00080000:2.0:1787784343.059217:0:6987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787784343.059252:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197017840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059968:0@lo:700: 00000100:00100000:2.0:1787784343.059282:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784343.059308:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189213540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784343.059338:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643059968 00000100:00100000:1.0:1787784343.059342:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643059968 00000100:00100000:1.0:1787784343.059395:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787784343.059402:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6987:x1874627643059968:12345-0@lo:700: 00000100:00100000:1.0:1787784343.059429:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1874627643060096:0@lo:700: 00000100:00100000:1.0:1787784343.059462:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784343.059486:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784343.059666:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060096 00000100:00100000:3.0:1787784343.059680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060096 00000100:00100000:3.0:1787784343.059724:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784343.059731:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1874627643060096:12345-0@lo:700: 00000100:00080000:2.0:1787784343.059790:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:2.0:1787784343.120619:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787784343.130834:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1874627643060096:12345-0@lo:700: Request processed in 71094us (71361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784343.130877:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787784343.130980:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431971161c0 x1874627643060096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787784359 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784343.130996:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1874627643060096:0@lo:700: 40000000:02000000:2.0:1787784343.131009:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1787784343.156987:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784343.243780:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6987:x1874627643059968:12345-0@lo:700: Request processed in 184368us (184487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784343.243800:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787784343.243901:0:6987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197017840 x1874627643059968/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784359 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784343.243920:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197017840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643059968:0@lo:700: 00000001:00100000:1.0:1787784343.255445:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787784343.255473:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:3.0:1787784343.330514:0:6987:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787784343.333563:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643060224:0@lo:5: 00000100:00100000:3.0:1787784343.333637:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784343.333724:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784343.333747:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060224 00000100:00100000:2.0:1787784343.333754:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060224 00000100:00100000:2.0:1787784343.333812:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784343.333822:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6987:x1874627643060224:12345-0@lo:5: 00002000:00080000:2.0:1787784343.344106:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787784343.344129:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787784343.355831:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6987:x1874627643060224:12345-0@lo:5: Request processed in 22003us (22187us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787784343.355844:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784343.355906:0:6987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a4b40 x1874627643060224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784359 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784343.355920:0:6987:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787784343.355947:0:6987:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9431962a4b40 x1874627643060224/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784359 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784343.355960:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6987:1874627643060224:0@lo:5: 00000004:00080000:2.0:1787784343.355976:0:6987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:1.0:1787784343.980327:0:7048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787784344.185272:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784345.209209:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784346.228635:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784347.253147:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784348.276673:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784348.468733:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643060736:0@lo:400: 00000100:00100000:0.0:1787784348.468820:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784348.468883:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784348.468890:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643060608:0@lo:400: 00000100:00100000:0.0:1787784348.468917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784348.468948:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060736 00000100:00100000:0.0:1787784348.468956:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060736 00000100:00100000:0.0:1787784348.469018:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784348.469028:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643060736:12345-0@lo:400: 00000100:00100000:0.0:1787784348.469079:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643060736:12345-0@lo:400: Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784348.469086:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784348.469109:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060608 00000100:00100000:0.0:1787784348.469113:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060608 00000100:00100000:0.0:1787784348.469139:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784348.469146:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643060608:12345-0@lo:400: 00000100:00100000:0.0:1787784348.469177:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643060608:12345-0@lo:400: Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784348.469183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787784348.469198:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784348.469203:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784348.469234:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196290780 x1874627643060608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784348.469249:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643060608:0@lo:400: 00010000:00080000:0.0:1787784348.469279:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962921c0 x1874627643060736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784348.469289:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643060736:0@lo:400: 00000100:00100000:1.0:1787784348.469530:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643060352:0@lo:400: 00000100:00100000:1.0:1787784348.469571:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784348.469596:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784348.469601:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643060480:0@lo:400: 00000100:00100000:1.0:1787784348.469659:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784348.470667:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060352 00000100:00100000:0.0:1787784348.470675:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060352 00000100:00100000:0.0:1787784348.470712:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784348.470720:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3293:x1874627643060352:12345-0@lo:400: 00000100:00100000:0.0:1787784348.470772:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3293:x1874627643060352:12345-0@lo:400: Request processed in 54us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784348.470779:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784348.470810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060480 00000100:00100000:0.0:1787784348.470814:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060480 00000100:00100000:0.0:1787784348.470837:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784348.470844:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643060480:12345-0@lo:400: 00000100:00100000:0.0:1787784348.470874:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643060480:12345-0@lo:400: Request processed in 31us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784348.470880:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784348.470958:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643060864:0@lo:13: 00000100:00100000:1.0:1787784348.470992:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787784348.471032:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196292580 x1874627643060480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784348.471046:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643060480:0@lo:400: 00000100:00100000:1.0:1787784348.471057:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643060352:0@lo:400: 00000100:00100000:0.0:1787784348.471238:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060864 00000100:00100000:0.0:1787784348.471243:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060864 00000100:00100000:0.0:1787784348.471274:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784348.471282:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643060864:12345-0@lo:13: 00002000:00000024:0.0:1787784348.471310:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784348.471346:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643060864:12345-0@lo:13: Request processed in 65us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784348.471353:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784348.474820:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962921c0 x1874627643060864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784348.474850:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643060864:0@lo:13: 00000001:00080000:3.0:1787784348.560547:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787784349.305420:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784350.324818:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784351.349781:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784352.374638:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784353.408413:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784353.589453:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643060992:0@lo:13: 00000100:00100000:2.0:1787784353.589526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784353.592394:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643060992 00000100:00100000:0.0:1787784353.592410:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643060992 00000100:00100000:0.0:1787784353.592478:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784353.592490:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643060992:12345-0@lo:13: 00002000:00000024:0.0:1787784353.592527:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784353.592621:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643060992:12345-0@lo:13: Request processed in 134us (3095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784353.592629:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787784353.592650:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784353.592687:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431970143c0 x1874627643060992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784353.592708:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787784353.592737:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643060992:0@lo:13: 00000100:00100000:1.0:1787784353.593894:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643061248:0@lo:400: 00000100:00100000:1.0:1787784353.593976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784353.594010:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784353.594017:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643061120:0@lo:400: 00000100:00100000:1.0:1787784353.594045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784353.594081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061248 00000100:00100000:1.0:1787784353.594087:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061248 00000100:00100000:1.0:1787784353.594136:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784353.594145:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643061248:12345-0@lo:400: 00000100:00100000:1.0:1787784353.594190:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643061248:12345-0@lo:400: Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784353.594197:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784353.594217:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061120 00000100:00100000:1.0:1787784353.594220:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061120 00000100:00100000:1.0:1787784353.594243:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787784353.594250:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3296:x1874627643061120:12345-0@lo:400: 00000100:00100000:1.0:1787784353.594279:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3296:x1874627643061120:12345-0@lo:400: Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784353.594286:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787784353.594318:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643061376:0@lo:400: 00000100:00100000:1.0:1787784353.594340:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784353.594397:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061376 00000100:00100000:1.0:1787784353.594402:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061376 00000100:00100000:1.0:1787784353.594431:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784353.594437:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643061376:12345-0@lo:400: 00000100:00100000:1.0:1787784353.594471:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643061376:12345-0@lo:400: Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784353.594485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787784353.594502:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784353.594528:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197115680 x1874627643061376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784353.594540:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643061376:0@lo:400: 00000100:00100000:1.0:1787784353.594569:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643061120:0@lo:400: 00010000:00080000:1.0:1787784353.594598:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943197117480 x1874627643061248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784353.594607:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643061248:0@lo:400: 00010000:00010000:1.0:1787784354.420603:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784355.461503:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784356.478809:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784357.494494:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784357.847882:0:7616:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784357.847888:0:7616:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787784357.848067:0:7616:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431bf2b0000 00000020:01000004:2.0:1787784357.848242:0:7616:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787784357.848262:0:7616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787784357.848691:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9431908f99b8) 00000020:00000080:3.0:1787784357.848715:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787784357.865203:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787784357.865768:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787784357.891745:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787784357.901854:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787784357.901902:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787784357.901966:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787784357.901994:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787784357.902990:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787784357.903010:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787784357.903028:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20ba862 00000020:01000004:3.0:1787784357.903041:0:7616:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787784357.903075:0:7616:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787784357.903081:0:7616:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787784357.903169:0:7616:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787784357.903203:0:7616:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787784357.903208:0:7616:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787784357.923695:0:7616:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787784357.923762:0:7616:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.159@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787784357.923767:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787784357.923770:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784357.923771:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784357.923773:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784357.923774:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784357.923776:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784357.923777:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784357.923779:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784357.923781:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784357.923783:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784357.923785:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784357.923789:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787784357.923792:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784357.923793:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784357.923794:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784357.923796:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784357.923796:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784357.923800:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784357.923801:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784357.923808:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784357.923809:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784357.923809:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784357.923810:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787784357.923846:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784357.923872:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643061504:0@lo:253: 00000100:00100000:2.0:1787784357.923965:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.924121:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784357.924240:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061504 00000100:00100000:0.0:1787784357.924251:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061504 00000100:00100000:0.0:1787784357.924581:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784357.924593:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:7616:x1874627643061504:12345-0@lo:253: 20000000:01000000:0.0:1787784357.924637:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787784357.924643:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787784357.924649:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787784357.924654:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787784357.926580:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787784357.926859:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787784357.926880:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787784357.926928:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787784357.926936:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787784357.926975:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787784357.927024:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787784357.927668:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787784357.927697:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:0.0:1787784357.927699:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:0.0:1787784357.927736:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787784357.927745:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787784357.927797:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787784357.927806:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:0.0:1787784357.927840:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787784357.927851:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787784357.927884:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787784357.927936:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787784357.929669:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787784357.929712:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:0.0:1787784357.929714:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:0.0:1787784357.929745:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787784357.929751:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787784357.929780:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787784357.929786:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:0.0:1787784357.929817:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787784357.929825:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787784357.929869:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787784357.929907:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787784357.929926:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787784357.929930:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787784357.929939:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787784357.929941:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787784357.929944:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787784357.929962:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787784357.929965:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787784357.930008:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787784357.930022:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787784357.931060:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787784357.931803:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787784357.931858:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787784357.931946:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787784357.931961:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787784357.931964:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787784357.932869:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787784357.932946:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787784357.933001:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787784357.933684:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787784357.933727:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787784357.933787:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787784357.933801:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787784357.933804:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787784357.934630:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787784357.934712:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787784357.934766:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787784357.935156:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787784357.935205:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787784357.935241:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787784357.935255:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787784357.935257:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787784357.936502:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787784357.936642:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787784357.936679:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787784357.937026:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787784357.937066:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787784357.937227:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787784357.937251:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787784357.937352:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937567:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937577:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937584:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937592:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937608:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.937619:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.937784:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.937811:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.937834:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061632:0@lo:104: 00000100:00100000:1.0:1787784357.937947:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784357.938060:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.938068:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 16 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.938077:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061760:0@lo:104: 00010000:00010000:1.0:1787784357.938191:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.938200:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 16 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.938209:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061888:0@lo:104: 00010000:00010000:1.0:1787784357.938236:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.938244:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 16 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.938252:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643062016:0@lo:104: 00010000:00010000:1.0:1787784357.938343:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.938354:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 16 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.938481:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643062144:0@lo:104: 00000100:00100000:1.0:1787784357.938510:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784357.938816:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787784357.938842:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784357.938920:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784357.938979:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.938998:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061632 00000100:00100000:2.0:1787784357.939009:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061632 00000100:00100000:2.0:1787784357.939058:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061760 00000100:00100000:2.0:1787784357.939061:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061760 00000100:00100000:2.0:1787784357.939069:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643061888 00000100:00100000:2.0:1787784357.939071:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643061888 00000100:00100000:2.0:1787784357.939094:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784357.939107:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5825:x1874627643061632:12345-0@lo:104: 00010000:00010000:2.0:1787784357.939122:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939204:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784357.939212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:5825:x1874627643061632:12345-0@lo:104: Request processed in 108us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.939220:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784357.939301:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784357.939308:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5825:x1874627643061760:12345-0@lo:104: 00010000:00010000:2.0:1787784357.939317:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939356:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784357.939361:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5825:x1874627643061760:12345-0@lo:104: Request processed in 55us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.939411:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784357.939425:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784357.939432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5825:x1874627643061888:12345-0@lo:104: 00010000:00010000:2.0:1787784357.939440:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939468:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787784357.939473:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5825:x1874627643061888:12345-0@lo:104: Request processed in 42us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.939479:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787784357.939499:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784357.939507:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939515:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784357.939520:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939530:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784357.939563:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784357.939570:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784357.939615:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939623:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784357.939648:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939657:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180030400/0xffb8d925c20ba846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba84d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939674:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784357.939677:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939683:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784357.939686:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939694:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784357.939700:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784357.939706:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784357.939727:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939734:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784357.939750:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939757:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20ba823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba82a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939769:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784357.939773:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939778:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180031400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784357.939781:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939789:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784357.939795:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784357.939801:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784357.939812:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939818:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784357.939823:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939840:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180031400/0xffb8d925c20ba807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba80e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.939852:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784357.939853:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784357.939856:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784357.939912:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197016940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643062272:0@lo:103: 00000100:00100000:2.0:1787784357.939956:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.940020:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643062400:0@lo:103: 00000100:00100000:2.0:1787784357.940067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.940092:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784357.940098:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197017840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643062528:0@lo:103: 00000100:00100000:2.0:1787784357.940121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.940156:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062272 00000100:00100000:2.0:1787784357.940162:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062272 00010000:00010000:2.0:1787784357.940185:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 17 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784357.940203:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062400 00000100:00100000:2.0:1787784357.940206:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062400 00010000:00010000:2.0:1787784357.940216:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 18 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784357.940225:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062528 00000100:00100000:2.0:1787784357.940228:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062528 00010000:00010000:2.0:1787784357.940238:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 19 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784357.940249:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784357.940266:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643062272:12345-0@lo:103: 00010000:00010000:2.0:1787784357.940282:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784357.940290:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 19 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940302:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 19 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940327:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784357.940357:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643062272:12345-0@lo:103: Request processed in 93us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.940451:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784357.940466:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784357.940472:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3295:x1874627643062400:12345-0@lo:103: 00010000:00010000:2.0:1787784357.940481:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784357.940486:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 18 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940495:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 18 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940505:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784357.940532:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3295:x1874627643062400:12345-0@lo:103: Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.940550:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784357.940562:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784357.940569:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3295:x1874627643062528:12345-0@lo:103: 00010000:00010000:2.0:1787784357.940577:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784357.940586:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 17 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940595:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 17 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.940605:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784357.940628:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3295:x1874627643062528:12345-0@lo:103: Request processed in 61us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.940635:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784357.940677:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197016940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643062272:0@lo:103: 00000100:00100000:2.0:1787784357.940708:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197017840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643062528:0@lo:103: 00000100:00100000:2.0:1787784357.940715:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197014b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643062400:0@lo:103: 00010000:00010000:3.0:1787784357.940845:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784357.940975:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031a00/0xffb8d925c20ba84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba846 expref: 16 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.940990:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061632:0@lo:104: 00010000:00010000:1.0:1787784357.941002:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1400/0xffb8d925c20ba82a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba823 expref: 15 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.941024:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061760:0@lo:104: 00010000:00010000:1.0:1787784357.941037:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba807 expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.941047:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643061888:0@lo:104: 00000100:00100000:0.0:1787784357.941452:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784357.941467:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062016 00000100:00100000:0.0:1787784357.941471:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062016 00000100:00100000:0.0:1787784357.941502:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062144 00000100:00100000:0.0:1787784357.941506:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062144 00000100:00100000:0.0:1787784357.941519:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784357.941528:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5825:x1874627643062016:12345-0@lo:104: 00010000:00010000:0.0:1787784357.941556:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941622:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784357.941628:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:5825:x1874627643062016:12345-0@lo:104: Request processed in 102us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.941635:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784357.941649:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784357.941656:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5825:x1874627643062144:12345-0@lo:104: 00010000:00010000:0.0:1787784357.941663:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941708:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784357.941713:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5825:x1874627643062144:12345-0@lo:104: Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.941719:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787784357.941773:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784357.941779:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941787:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784357.941792:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941802:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784357.941810:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784357.941817:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784357.941856:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941862:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784357.941880:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941887:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7e4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941912:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784357.941915:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941921:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784357.941924:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941931:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784357.941938:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784357.941943:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784357.941960:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941967:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784357.941973:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941980:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180030c00/0xffb8d925c20ba7b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7ba expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.941995:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784357.941996:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784357.941998:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784357.942013:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643062656:0@lo:103: 00000100:00100000:0.0:1787784357.942060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784357.942113:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784357.942119:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643062784:0@lo:103: 00000100:00100000:0.0:1787784357.942142:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784357.942169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062656 00000100:00100000:0.0:1787784357.942173:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062656 00010000:00010000:0.0:1787784357.942194:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784357.942213:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062784 00000100:00100000:0.0:1787784357.942216:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062784 00010000:00010000:0.0:1787784357.942229:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 15 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784357.942242:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784357.942248:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3293:x1874627643062656:12345-0@lo:103: 00010000:00010000:0.0:1787784357.942258:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784357.942264:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 15 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942444:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 15 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942463:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784357.942494:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3293:x1874627643062656:12345-0@lo:103: Request processed in 246us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.942501:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784357.942516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784357.942523:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3293:x1874627643062784:12345-0@lo:103: 00010000:00010000:0.0:1787784357.942557:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784357.942563:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942573:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942586:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942595:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942613:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942621:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942629:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942637:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942643:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784357.942648:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942656:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942680:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.942691:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784357.942716:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3293:x1874627643062784:12345-0@lo:103: Request processed in 194us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.942723:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784357.942763:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643062784:0@lo:103: 00000100:00100000:0.0:1787784357.942772:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643062656:0@lo:103: 00010000:00010000:0.0:1787784357.942812:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784357.942992:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031800/0xffb8d925c20ba7e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba7dd expref: 13 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.943005:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643062016:0@lo:104: 00010000:00010000:1.0:1787784357.943015:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030600/0xffb8d925c20ba7ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba7b3 expref: 12 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784357.943022:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1874627643062144:0@lo:104: 00010000:00010000:1.0:1787784357.943053:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.943063:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.943070:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784357.943077:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030000/0xffb8d925c20ba869 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787784357.943103:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787784357.992079:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:7616:x1874627643061504:12345-0@lo:253: Request processed in 67471us (68096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784357.992217:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197017480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643061504:0@lo:253: 10000000:01000000:3.0:1787784357.992245:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787784357.992250:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784357.992252:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787784357.992254:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784357.992256:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787784357.992257:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784357.992259:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784357.992261:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787784357.992262:0:7616:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787784357.992264:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784357.992266:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787784357.992424:0:7616:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431bf2b0000 from lustre-OST0001 10000000:01000000:3.0:1787784357.992462:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787784357.992465:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787784357.992476:0:7616:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431857819b8 local copy 10000000:01000000:3.0:1787784357.992482:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787784357.992550:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.992565:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.992598:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784357.992622:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643062912:0@lo:101: 00000100:00100000:3.0:1787784357.992676:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784357.992716:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784357.992796:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787784357.992837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643062912 00000100:00100000:2.0:1787784357.992845:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643062912 00000100:00100000:2.0:1787784357.992897:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787784357.992907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+11:7616:x1874627643062912:12345-0@lo:101: 00010000:00010000:2.0:1787784357.992922:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784357.992939:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba870 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.992968:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba870 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.992980:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba870 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.992998:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2045a00, rc 0) 00000100:00100000:2.0:1787784357.993038:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643062912:12345-0@lo:101: Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.993044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787784357.993351:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643062912:0@lo:101: 00010000:00010000:2.0:1787784357.993455:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.993468:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784357.993659:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063040:0@lo:501: 00000100:00100000:2.0:1787784357.993702:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.993789:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784357.993923:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063040 00000100:00100000:0.0:1787784357.993930:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063040 00000100:00100000:0.0:1787784357.994016:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784357.994026:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063040:12345-0@lo:501: 00000100:00100000:0.0:1787784357.995008:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063040:12345-0@lo:501: Request processed in 978us (1299us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784357.995021:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784357.995224:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063040:0@lo:501: 10000000:01000000:2.0:1787784357.995252:0:7616:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787784357.995394:0:7616:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787784357.995404:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.995417:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.995426:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.995479:0:7616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784357.995513:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431bf2b0000 10000000:01000000:2.0:1787784357.995519:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784357.995528:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787784357.995531:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784357.995566:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787784357.995570:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787784357.995611:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.995620:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.995631:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784357.995653:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063168:0@lo:101: 00000100:00100000:2.0:1787784357.995700:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.995797:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee46c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787784357.995882:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784357.995892:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.995900:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784357.995904:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.995916:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784357.995924:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784357.995931:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784357.995960:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.995967:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784357.996000:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.996009:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513400/0xffb8d925c20ba870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xffb8d925c20ba877 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.996039:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784357.996041:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784357.996043:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784357.996127:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063168 00000100:00100000:0.0:1787784357.996135:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063168 00000100:00100000:0.0:1787784357.996185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784357.996195:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063168:12345-0@lo:101: 00010000:00010000:0.0:1787784357.996212:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784357.996230:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba87e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.996261:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.996501:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784357.996512:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030c00, rc 0) 00000100:00100000:0.0:1787784357.996583:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643063168:12345-0@lo:101: Request processed in 390us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.996590:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784357.996703:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063168:0@lo:101: 00010000:00010000:3.0:1787784357.996720:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784357.996730:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784357.996848:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063424:0@lo:501: 00000100:00100000:3.0:1787784357.996901:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784357.996936:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784357.996984:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063424 00000100:00100000:0.0:1787784357.996990:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063424 00000100:00100000:0.0:1787784357.997027:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784357.997034:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643063424:12345-0@lo:501: 00000100:00100000:2.0:1787784357.997198:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643063296:0@lo:103: 00000100:00100000:2.0:1787784357.997235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.997296:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063296 00000100:00100000:2.0:1787784357.997300:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063296 00000100:00100000:2.0:1787784357.997340:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784357.997347:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3295:x1874627643063296:12345-0@lo:103: 00010000:00010000:2.0:1787784357.997359:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784357.997408:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba870 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784357.997431:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784357.997463:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3295:x1874627643063296:12345-0@lo:103: Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784357.997471:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784357.997505:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643063296:0@lo:103: 00000100:00100000:0.0:1787784357.997895:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063424:12345-0@lo:501: Request processed in 859us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.997902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784357.998036:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063424:0@lo:501: 00000100:00100000:2.0:1787784357.998161:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063552:0@lo:503: 00000100:00100000:2.0:1787784357.998217:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.998254:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784357.998436:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063552 00000100:00100000:0.0:1787784357.998443:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063552 00000100:00100000:0.0:1787784357.998515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787784357.998524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063552:12345-0@lo:503: 00000100:00100000:0.0:1787784357.998723:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063552:12345-0@lo:503: Request processed in 201us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784357.998730:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787784357.998846:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063552:0@lo:503: 00000040:00080000:2.0:1787784357.999205:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784357.999295:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063680:0@lo:502: 00000100:00100000:2.0:1787784357.999340:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784357.999585:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784357.999698:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063680 00000100:00100000:3.0:1787784357.999704:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063680 00000100:00100000:3.0:1787784357.999734:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784357.999742:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063680:12345-0@lo:502: 00000100:00100000:3.0:1787784357.999980:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063680:12345-0@lo:502: Request processed in 238us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784357.999988:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784358.000199:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063680:0@lo:502: 00000040:00080000:2.0:1787784358.000796:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787784358.000879:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787784358.000918:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787784358.000994:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787784358.001038:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787784358.001073:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787784358.001208:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063808:0@lo:502: 00000100:00100000:2.0:1787784358.001356:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.001678:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784358.001757:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063808 00000100:00100000:3.0:1787784358.001767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063808 00000100:00100000:3.0:1787784358.001874:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784358.001888:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063808:12345-0@lo:502: 00000100:00100000:3.0:1787784358.002234:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063808:12345-0@lo:502: Request processed in 348us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.002252:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784358.002425:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063808:0@lo:502: 00000040:00080000:2.0:1787784358.002615:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787784358.002633:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787784358.003613:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787784358.003625:0:7622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787784358.003633:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784358.003636:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787784358.003641:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787784358.003661:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9431b9ec8000) 00000020:00000080:2.0:1787784358.003689:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787784358.003694:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787784358.003768:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431bf2b0000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787784358.003777:0:7622:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787784358.003784:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20ba893 00010000:00010000:2.0:1787784358.009731:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787784358.010236:0:7622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787784358.012808:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787784358.013299:0:7622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787784358.017715:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787784358.018495:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787784358.020483:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787784358.020501:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784358.020510:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784358.020513:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787784358.020517:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784358.020523:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784358.020524:0:7622:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784358.020528:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784358.020531:0:7622:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784358.020622:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784358.020627:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784358.020628:0:7622:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787784358.020632:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787784358.020909:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787784358.020944:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787784358.020978:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.020992:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784358.021002:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431bf2b0000 from 1 10000000:01000000:1.0:1787784358.021005:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784358.021053:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.021062:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.021075:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.021238:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063936:0@lo:101: 00000100:00100000:1.0:1787784358.021343:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.021435:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.021579:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643063936 00000100:00100000:2.0:1787784358.021590:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643063936 00000100:00100000:2.0:1787784358.021681:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787784358.021694:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:7616:x1874627643063936:12345-0@lo:101: 00010000:00010000:2.0:1787784358.021713:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784358.021728:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba89a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.021761:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.021775:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.021785:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2045a00, rc 0) 00000100:00100000:2.0:1787784358.021844:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643063936:12345-0@lo:101: Request processed in 152us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.021852:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787784358.021933:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643063936:0@lo:101: 00010000:00010000:1.0:1787784358.021951:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.021961:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.022095:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064064:0@lo:501: 00000100:00100000:1.0:1787784358.022129:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.022396:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784358.022501:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064064 00000100:00100000:0.0:1787784358.022507:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064064 00000100:00100000:0.0:1787784358.022548:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787784358.022557:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064064:12345-0@lo:501: 00000100:00100000:0.0:1787784358.022865:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064064:12345-0@lo:501: Request processed in 309us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784358.022880:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784358.023241:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064064:0@lo:501: 00000100:00100000:1.0:1787784358.023307:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064192:0@lo:503: 00000100:00100000:1.0:1787784358.023386:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.023419:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.024525:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064192 00000100:00100000:2.0:1787784358.024546:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064192 00000100:00100000:2.0:1787784358.024605:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784358.024616:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064192:12345-0@lo:503: 00000100:00100000:2.0:1787784358.025053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064192:12345-0@lo:503: Request processed in 438us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.025063:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787784358.030307:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064192:0@lo:503: 00000040:00080000:1.0:1787784358.030864:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784358.030982:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064320:0@lo:502: 00000100:00100000:1.0:1787784358.032303:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.032407:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.032553:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064320 00000100:00100000:2.0:1787784358.032563:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064320 00000100:00100000:2.0:1787784358.032635:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784358.032647:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064320:12345-0@lo:502: 00000100:00100000:2.0:1787784358.033029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064320:12345-0@lo:502: Request processed in 383us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.033038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787784358.033322:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064320:0@lo:502: 00000040:00080000:1.0:1787784358.033718:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787784358.033786:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787784358.033835:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064448:0@lo:502: 00000100:00100000:1.0:1787784358.033898:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.033931:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784358.034043:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064448 00000100:00100000:3.0:1787784358.034051:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064448 00000100:00100000:2.0:1787784358.034476:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787784358.034489:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064448:12345-0@lo:502: 00000100:00100000:2.0:1787784358.034738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064448:12345-0@lo:502: Request processed in 252us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.034747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787784358.034863:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064448:0@lo:502: 00000040:00080000:1.0:1787784358.035003:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787784358.035017:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787784358.035783:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784358.035796:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784358.035799:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784358.035807:0:7626:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431bf2b0000 00000020:00000080:3.0:1787784358.035810:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784358.035835:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784358.035839:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784358.035840:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787784358.035843:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787784358.035994:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787784358.036017:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784358.036045:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.036059:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784358.036242:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787784358.036245:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431bf2b0000 10000000:01000000:1.0:1787784358.036249:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431bf2b0000 10000000:01000000:1.0:1787784358.036254:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787784358.036261:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431bf2b0000 from 1 10000000:01000000:1.0:1787784358.036264:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787784358.036314:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.036323:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.036337:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.036402:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064576:0@lo:101: 00000100:00100000:1.0:1787784358.036494:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.036558:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784358.036681:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064576 00000100:00100000:3.0:1787784358.036690:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064576 00000100:00100000:3.0:1787784358.036778:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787784358.036791:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643064576:12345-0@lo:101: 00010000:00010000:3.0:1787784358.036811:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784358.036830:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba8a8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784358.036866:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784358.036881:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784358.036894:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513400, rc 0) 00000100:00100000:3.0:1787784358.036961:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064576:12345-0@lo:101: Request processed in 172us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.036968:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787784358.037063:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064576:0@lo:101: 00010000:00010000:1.0:1787784358.039251:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.039287:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.039550:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064704:0@lo:501: 00000100:00100000:1.0:1787784358.039643:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.042660:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.042812:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064704 00000100:00100000:2.0:1787784358.042826:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064704 00000100:00100000:2.0:1787784358.042890:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787784358.042902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064704:12345-0@lo:501: 00000100:00100000:2.0:1787784358.043458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064704:12345-0@lo:501: Request processed in 555us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.043469:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787784358.043598:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064704:0@lo:501: 00000100:00100000:1.0:1787784358.043669:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064832:0@lo:503: 00000100:00100000:1.0:1787784358.043733:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.043767:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784358.043841:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064832 00000100:00100000:3.0:1787784358.043847:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064832 00000100:00100000:3.0:1787784358.043881:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787784358.043890:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064832:12345-0@lo:503: 00000100:00100000:3.0:1787784358.044189:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064832:12345-0@lo:503: Request processed in 299us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.044195:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787784358.044295:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064832:0@lo:503: 00000040:00080000:1.0:1787784358.044727:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787784358.044807:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064960:0@lo:502: 00000100:00100000:1.0:1787784358.044857:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.044880:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784358.045331:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643064960 00000100:00100000:3.0:1787784358.045339:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643064960 00000100:00100000:3.0:1787784358.045389:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787784358.045397:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064960:12345-0@lo:502: 00000100:00100000:3.0:1787784358.045664:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643064960:12345-0@lo:502: Request processed in 267us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.045673:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784358.045915:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643064960:0@lo:502: 00000040:00080000:1.0:1787784358.046317:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787784358.046420:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787784358.046460:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787784358.046511:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787784358.046562:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787784358.046615:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787784358.046650:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787784358.046689:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787784358.046738:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787784358.046775:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787784358.046810:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787784358.046881:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787784358.046924:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787784358.046959:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787784358.047014:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787784358.047050:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787784358.047627:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787784358.047726:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787784358.047771:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787784358.047810:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787784358.047862:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787784358.047906:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787784358.047968:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787784358.048023:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787784358.048064:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787784358.048187:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787784358.048246:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787784358.050428:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787784358.050550:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787784358.050667:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787784358.050710:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787784358.050747:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787784358.050783:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787784358.050832:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787784358.050875:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787784358.050927:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787784358.050961:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787784358.051036:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643065088:0@lo:502: 00000100:00100000:2.0:1787784358.051343:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.051693:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.051840:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065088 00000100:00100000:2.0:1787784358.051851:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065088 00000100:00100000:2.0:1787784358.051925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784358.051937:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643065088:12345-0@lo:502: 00000100:00100000:2.0:1787784358.052392:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643065088:12345-0@lo:502: Request processed in 455us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.052402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787784358.052524:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643065088:0@lo:502: 00000040:00080000:0.0:1787784358.052663:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787784358.052680:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787784358.053922:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787784358.053950:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9431908fb370) 00000020:00000080:3.0:1787784358.053984:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787784358.054157:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431bf2b0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787784358.054164:0:7627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431bf2b0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787784358.054167:0:7627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431bf2b0000 3 00010000:00080000:3.0:1787784358.054228:0:7627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431bf6e8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1787784358.058558:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787784358.058904:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787784358.058976:0:7627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784358.058995:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xffb8d925c20ba8bd 00000100:00080000:0.0:1787784358.059011:0:7627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784358.059019:0:7627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9431bf6e8000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784358.059069:0:7627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff943196292d00 x1874627643065216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784358.059171:0:7627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787784358.059280:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643065216:0@lo:38: 00000100:00100000:1.0:1787784358.059421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784358.059697:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065216 00000100:00100000:0.0:1787784358.059707:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065216 00000100:00100000:0.0:1787784358.059759:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784358.059770:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643065216:12345-0@lo:38: 00010000:00080000:0.0:1787784358.059799:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1787784358.059850:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xffb8d925c20ba8c4 00000004:00100000:0.0:1787784358.059875:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787784358.059919:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9431bed63800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784358.059990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874627643065216:12345-0@lo:38: Request processed in 220us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784358.059998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784358.060029:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643065600:0@lo:400: 00000100:00100000:0.0:1787784358.060065:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784358.060211:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784358.060218:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643065472:0@lo:400: 00000100:00100000:0.0:1787784358.060247:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787784358.060349:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff943196292d00 x1874627643065216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784358.060382:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787784358.060394:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787784358.060403:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787784358.060408:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784358.060411:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784358.060418:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643065216:0@lo:38: 00000100:00100000:0.0:1787784358.060506:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065600 00000100:00100000:0.0:1787784358.060511:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065600 00000100:00100000:0.0:1787784358.060578:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784358.060587:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643065600:12345-0@lo:400: 00000100:00100000:0.0:1787784358.060631:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643065600:12345-0@lo:400: Request processed in 46us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784358.060638:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787784358.060672:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a52c0 x1874627643065600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784358.060682:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643065600:0@lo:400: 00000100:00080000:1.0:1787784358.060732:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784358.062517:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643065344:0@lo:400: 00000100:00100000:0.0:1787784358.062631:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784358.069433:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065472 00000100:00100000:3.0:1787784358.069458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065472 00000100:00100000:3.0:1787784358.069573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065344 00000100:00100000:3.0:1787784358.069577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065344 00000100:00100000:3.0:1787784358.069604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784358.069616:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94318a55f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643065472:12345-0@lo:400: 00000100:00100000:3.0:1787784358.069746:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94318a55f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643065472:12345-0@lo:400: Request processed in 132us (9498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.069773:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784358.069795:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787784358.069803:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643065344:12345-0@lo:400: 00000100:00100000:3.0:1787784358.069842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643065344:12345-0@lo:400: Request processed in 40us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.069848:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787784358.069938:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784358.070033:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a5e00 x1874627643065472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784358.070053:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643065472:0@lo:400: 00010000:00080000:0.0:1787784358.070173:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431962a7480 x1874627643065344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784358.070185:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643065344:0@lo:400: 00000100:00100000:2.0:1787784358.071249:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40f0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7629:1874627643065728:0@lo:901: 00000100:00100000:2.0:1787784358.071336:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.071415:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091540 going to sleep for 11 seconds 00000040:00080000:0.0:1787784358.071555:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787784358.071690:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065728 00000100:00100000:3.0:1787784358.071698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065728 00000100:00100000:3.0:1787784358.071752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784358.071762:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7629:x1874627643065728:12345-0@lo:901: 00000100:00100000:3.0:1787784358.072498:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7629:x1874627643065728:12345-0@lo:901: Request processed in 735us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784358.072507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787784358.072655:0:7629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431bf40f0c0 x1874627643065728/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787784374 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784358.072671:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40f0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7629:1874627643065728:0@lo:901: 00000020:01000000:2.0:1787784358.072978:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787784358.073017:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784358.073075:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.073164:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784358.073241:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784358.073244:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784358.073246:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784358.073247:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784358.073249:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784358.073251:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784358.073253:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784358.073255:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784358.073257:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784358.073259:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784358.073260:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784358.073266:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787784358.073269:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784358.073271:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784358.073272:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784358.073273:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784358.073274:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784358.073276:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784358.073277:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784358.073278:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784358.073279:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784358.073280:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784358.073281:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784358.073308:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784358.073331:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643065856:0@lo:253: 00000100:00100000:2.0:1787784358.073412:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.073465:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091300 going to sleep for 11 seconds 00000100:00080000:2.0:1787784358.073488:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784358.073559:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065856 00000100:00100000:1.0:1787784358.073566:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065856 00000100:00100000:1.0:1787784358.073619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784358.073628:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7616:x1874627643065856:12345-0@lo:253: 20000000:01000000:1.0:1787784358.073666:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787784358.073687:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787784358.105544:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787784358.105563:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787784358.106823:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787784358.106834:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787784358.106866:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.106890:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.106902:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.106956:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.106998:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.107018:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643065984:0@lo:104: 00000100:00100000:1.0:1787784358.107122:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784358.107182:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431868933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784358.107353:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643065984 00000100:00100000:2.0:1787784358.107387:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643065984 00000100:00100000:2.0:1787784358.107447:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784358.107458:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643065984:12345-0@lo:104: 00010000:00010000:2.0:1787784358.107474:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107561:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784358.107569:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:5847:x1874627643065984:12345-0@lo:104: Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.107577:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787784358.107607:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784358.107614:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107623:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2044a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784358.107628:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107638:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784358.107646:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784358.107653:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784358.107688:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107696:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784358.107717:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107725:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba81c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107758:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784358.107760:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784358.107762:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784358.107787:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643066112:0@lo:103: 00000100:00100000:2.0:1787784358.107828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.107873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066112 00000100:00100000:2.0:1787784358.107877:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066112 00010000:00010000:2.0:1787784358.107896:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 15 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784358.107919:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784358.107926:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3295:x1874627643066112:12345-0@lo:103: 00010000:00010000:2.0:1787784358.107939:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784358.107944:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 15 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107956:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 15 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107975:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.107984:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787784358.108000:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002284384s 00010000:00010000:2.0:1787784358.108006:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108025:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108032:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108039:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108044:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784358.108049:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108057:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108066:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784358.108075:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784358.108176:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3295:x1874627643066112:12345-0@lo:103: Request processed in 250us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.108184:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784358.108270:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643066112:0@lo:103: 00010000:00010000:1.0:1787784358.108620:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1200/0xffb8d925c20ba81c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba815 expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.108635:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874627643065984:0@lo:104: 00010000:00010000:1.0:1787784358.108652:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.108663:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.108671:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784358.108678:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba8cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784358.116915:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:7616:x1874627643065856:12345-0@lo:253: Request processed in 43274us (43489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784358.116936:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784358.117039:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7616:1874627643065856:0@lo:253: 10000000:01000000:2.0:1787784358.117060:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787784358.117064:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784358.117066:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784358.117068:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784358.117157:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784358.117159:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784358.117161:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784358.117162:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784358.117164:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787784358.117166:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787784358.117169:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784358.117171:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784358.117199:0:7616:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787784358.126034:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784358.126276:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787784358.126577:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784358.126790:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787784358.127019:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784358.127319:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787784358.129885:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787784358.520401:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787784358.538512:0:7616:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787784358.538526:0:7616:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787784358.538592:0:7616:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787784358.538694:0:7616:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787784358.538714:0:7616:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787784358.538779:0:7616:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787784358.715514:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784358.715571:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643066240:0@lo:13: 00000100:00100000:1.0:1787784358.715706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784358.718207:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066240 00000100:00100000:2.0:1787784358.718229:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066240 00000100:00100000:2.0:1787784358.718314:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784358.718328:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643066240:12345-0@lo:13: 00002000:00000024:2.0:1787784358.718421:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784358.718551:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643066240:12345-0@lo:13: Request processed in 227us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784358.718562:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787784358.719169:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbb480 x1874627643066240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784358.719197:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643066240:0@lo:13: 00010000:00010000:2.0:1787784359.540650:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784360.564621:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784361.588647:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784362.614216:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784363.318707:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643066368:0@lo:400: 00000100:00100000:2.0:1787784363.318825:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784363.318902:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643066880:0@lo:400: 00000100:00100000:2.0:1787784363.318936:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784363.318969:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784363.318976:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643066496:0@lo:400: 00000100:00100000:2.0:1787784363.319001:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784363.319036:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643066624:0@lo:400: 00000100:00100000:2.0:1787784363.319063:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784363.319085:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784363.319090:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643066752:0@lo:400: 00000100:00100000:2.0:1787784363.319146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784363.319189:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066368 00000100:00100000:2.0:1787784363.319200:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066368 00000100:00100000:2.0:1787784363.319263:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787784363.319274:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3293:x1874627643066368:12345-0@lo:400: 00000100:00100000:2.0:1787784363.319334:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3293:x1874627643066368:12345-0@lo:400: Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784363.319342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787784363.319406:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066880 00000100:00100000:2.0:1787784363.319410:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066880 00000100:00100000:2.0:1787784363.319444:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066496 00000100:00100000:2.0:1787784363.319447:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066496 00000100:00100000:2.0:1787784363.319459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066624 00000100:00100000:2.0:1787784363.319462:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066624 00000100:00100000:2.0:1787784363.319479:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784363.319498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643066880:12345-0@lo:400: 00000100:00100000:2.0:1787784363.319535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643066880:12345-0@lo:400: Request processed in 48us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784363.319541:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784363.319556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784363.319562:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643066496:12345-0@lo:400: 00000100:00100000:2.0:1787784363.319589:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643066496:12345-0@lo:400: Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784363.319595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784363.319605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784363.319612:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643066624:12345-0@lo:400: 00000100:00100000:2.0:1787784363.319650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643066624:12345-0@lo:400: Request processed in 39us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784363.319664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784363.319694:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643066752 00000100:00100000:2.0:1787784363.319699:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643066752 00000100:00100000:2.0:1787784363.319731:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784363.319739:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643066752:12345-0@lo:400: 00000100:00100000:2.0:1787784363.319771:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643066752:12345-0@lo:400: Request processed in 34us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784363.319777:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784363.319822:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643066496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784363.319838:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643066496:0@lo:400: 00000100:00100000:2.0:1787784363.319848:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643066368:0@lo:400: 00010000:00080000:2.0:1787784363.319858:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40da40 x1874627643066880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784363.319867:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643066880:0@lo:400: 00000100:00080000:2.0:1787784363.319899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784363.319904:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784363.319918:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40de00 x1874627643066752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784363.319927:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643066752:0@lo:400: 00010000:00080000:2.0:1787784363.319936:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40c3c0 x1874627643066624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784363.319944:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643066624:0@lo:400: 00010000:00010000:2.0:1787784363.642644:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784363.831289:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643067008:0@lo:13: 00000100:00100000:3.0:1787784363.831412:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784363.831540:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067008 00000100:00100000:3.0:1787784363.831550:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067008 00000100:00100000:3.0:1787784363.831608:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784363.831628:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643067008:12345-0@lo:13: 00002000:00000024:3.0:1787784363.831673:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784363.831722:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643067008:12345-0@lo:13: Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784363.831729:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787784363.831793:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a6940 x1874627643067008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784363.831818:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643067008:0@lo:13: 00010000:00010000:3.0:1787784364.663075:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787784365.364558:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787784365.364570:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431b9ffe000 from 30 10000000:01000000:2.0:1787784365.364579:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784365.364652:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.364667:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.364680:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784365.364723:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067136:0@lo:101: 00000100:00100000:2.0:1787784365.364839:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.364934:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.364968:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067136 00000100:00100000:2.0:1787784365.364978:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067136 00000100:00100000:2.0:1787784365.365056:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787784365.365067:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643067136:12345-0@lo:101: 00010000:00010000:2.0:1787784365.365095:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784365.365111:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba8d2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.365145:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.365157:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.365168:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2044800, rc 0) 00000100:00100000:2.0:1787784365.366170:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067136:12345-0@lo:101: Request processed in 1095us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.366188:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787784365.378852:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067136:0@lo:101: 00010000:00010000:0.0:1787784365.378908:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.378925:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.379087:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067264:0@lo:501: 00000100:00100000:0.0:1787784365.379181:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.379290:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.382420:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067264 00000100:00100000:2.0:1787784365.382445:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067264 00000100:00100000:2.0:1787784365.382552:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784365.382725:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067264:12345-0@lo:501: 00000100:00100000:2.0:1787784365.383328:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067264:12345-0@lo:501: Request processed in 605us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.388495:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787784365.389237:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067264:0@lo:501: 00000100:00100000:2.0:1787784365.389312:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067392:0@lo:503: 00000100:00100000:2.0:1787784365.389428:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.390190:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.392737:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067392 00000100:00100000:0.0:1787784365.392758:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067392 00000100:00100000:0.0:1787784365.392842:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784365.392855:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067392:12345-0@lo:503: 00000100:00100000:0.0:1787784365.394328:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067392:12345-0@lo:503: Request processed in 1464us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.394342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787784365.398757:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067392:0@lo:503: 00000100:00100000:2.0:1787784365.399762:0:7908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7908:1874627643067520:0@lo:502: 00000100:00100000:2.0:1787784365.399878:0:7908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.399953:0:7908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784365.400579:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067520 00000100:00100000:3.0:1787784365.400592:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067520 00000100:00100000:3.0:1787784365.400682:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787784365.400695:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7908:x1874627643067520:12345-0@lo:502: 00000100:00100000:3.0:1787784365.401118:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7908:x1874627643067520:12345-0@lo:502: Request processed in 424us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784365.401126:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787784365.401699:0:7908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7908:1874627643067520:0@lo:502: 00000100:00100000:2.0:1787784365.401798:0:7908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7908:1874627643067648:0@lo:502: 00000100:00100000:2.0:1787784365.401853:0:7908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.401898:0:7908:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.401967:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067648 00000100:00100000:0.0:1787784365.401974:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067648 00000100:00100000:0.0:1787784365.402018:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787784365.402036:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7908:x1874627643067648:12345-0@lo:502: 00000100:00100000:0.0:1787784365.402271:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:7908:x1874627643067648:12345-0@lo:502: Request processed in 236us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.402279:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787784365.402488:0:7908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7908:1874627643067648:0@lo:502: 00000040:00080000:2.0:1787784365.402517:0:7908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787784365.404484:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787784365.404529:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784365.404544:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.404558:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784365.404572:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787784365.404575:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787784365.404578:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787784365.404635:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.404655:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.404669:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.404703:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067776:0@lo:101: 00000100:00100000:0.0:1787784365.404788:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.404848:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.405300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067776 00000100:00100000:2.0:1787784365.405314:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067776 00000100:00100000:2.0:1787784365.405427:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784365.405439:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643067776:12345-0@lo:101: 00010000:00010000:2.0:1787784365.405459:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784365.405484:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba8e0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.405519:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.405532:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.405541:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2044600, rc 0) 00000100:00100000:2.0:1787784365.406385:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643067776:12345-0@lo:101: Request processed in 922us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.406397:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787784365.406430:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067776:0@lo:101: 00010000:00010000:0.0:1787784365.406456:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.406487:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.406572:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067904:0@lo:501: 00000100:00100000:0.0:1787784365.406608:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.406666:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.407141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643067904 00000100:00100000:2.0:1787784365.407148:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643067904 00000100:00100000:2.0:1787784365.407214:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787784365.407223:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643067904:12345-0@lo:501: 00000100:00100000:2.0:1787784365.407617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643067904:12345-0@lo:501: Request processed in 393us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.407626:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784365.408487:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643067904:0@lo:501: 00000100:00100000:0.0:1787784365.408547:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068032:0@lo:503: 00000100:00100000:0.0:1787784365.408620:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.408670:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.408752:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068032 00000100:00100000:2.0:1787784365.408760:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068032 00000100:00100000:2.0:1787784365.408802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787784365.408812:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643068032:12345-0@lo:503: 00000100:00100000:2.0:1787784365.409221:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643068032:12345-0@lo:503: Request processed in 408us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.409238:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787784365.409334:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068032:0@lo:503: 00000100:00100000:2.0:1787784365.410171:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7909:1874627643068160:0@lo:502: 00000100:00100000:2.0:1787784365.410237:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.410280:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.410338:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068160 00000100:00100000:0.0:1787784365.410345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068160 00000100:00100000:0.0:1787784365.410413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787784365.410422:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:7909:x1874627643068160:12345-0@lo:502: 00000100:00100000:0.0:1787784365.410715:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:7909:x1874627643068160:12345-0@lo:502: Request processed in 293us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.410723:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787784365.412044:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7909:1874627643068160:0@lo:502: 00000020:01000000:2.0:1787784365.412122:0:7909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784365.412138:0:7909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784365.412141:0:7909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784365.412148:0:7909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784365.412150:0:7909:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787784365.412211:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7909:1874627643068288:0@lo:502: 00000100:00100000:2.0:1787784365.412300:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.412347:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068288 00000100:00100000:2.0:1787784365.412354:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068288 00000100:00100000:2.0:1787784365.412431:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784365.412442:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:7909:x1874627643068288:12345-0@lo:502: 00000100:00100000:2.0:1787784365.415437:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:7909:x1874627643068288:12345-0@lo:502: Request processed in 2978us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.415459:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787784365.415591:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.415628:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7909:1874627643068288:0@lo:502: 00000020:01000000:3.0:1787784365.416290:0:7909:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784365.416304:0:7909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784365.416307:0:7909:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787784365.416315:0:7909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787784365.416512:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787784365.416536:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787784365.416550:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.416563:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784365.416597:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787784365.416600:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94318875c800 from 30 10000000:01000000:0.0:1787784365.416603:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784365.416659:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.416667:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.416678:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.416704:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068416:0@lo:101: 00000100:00100000:0.0:1787784365.416772:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.416816:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.417216:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068416 00000100:00100000:2.0:1787784365.417227:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068416 00000100:00100000:2.0:1787784365.417289:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787784365.417352:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643068416:12345-0@lo:101: 00010000:00010000:2.0:1787784365.417404:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784365.417436:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba8ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.417481:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.417496:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.417508:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431c2045400, rc 0) 00000100:00100000:2.0:1787784365.417567:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643068416:12345-0@lo:101: Request processed in 219us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.421499:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068416:0@lo:101: 00010000:00010000:0.0:1787784365.421541:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.421557:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.421683:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068544:0@lo:501: 00000100:00100000:0.0:1787784365.421776:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.421841:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784365.422063:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068544 00000100:00100000:3.0:1787784365.422072:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068544 00000100:00100000:3.0:1787784365.422125:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787784365.422136:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643068544:12345-0@lo:501: 00000100:00100000:3.0:1787784365.423039:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643068544:12345-0@lo:501: Request processed in 900us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784365.423052:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787784365.424758:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068544:0@lo:501: 00000100:00100000:0.0:1787784365.424850:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068672:0@lo:503: 00000100:00100000:0.0:1787784365.424950:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.425002:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068672 00000100:00100000:0.0:1787784365.425009:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068672 00000100:00100000:0.0:1787784365.425071:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787784365.425082:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643068672:12345-0@lo:503: 00000100:00100000:2.0:1787784365.425451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787784365.425736:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643068672:12345-0@lo:503: Request processed in 561us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.425747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787784365.425801:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.425820:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643068672:0@lo:503: 00000100:00100000:0.0:1787784365.426294:0:7910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7910:1874627643068800:0@lo:502: 00000100:00100000:0.0:1787784365.426344:0:7910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.426434:0:7910:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.431392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068800 00000100:00100000:2.0:1787784365.431415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068800 00000100:00100000:2.0:1787784365.431505:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787784365.431518:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:7910:x1874627643068800:12345-0@lo:502: 00000100:00100000:2.0:1787784365.432033:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:7910:x1874627643068800:12345-0@lo:502: Request processed in 515us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.432044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787784365.432271:0:7910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3421c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7910:1874627643068800:0@lo:502: 00000100:00100000:1.0:1787784365.432389:0:7910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7910:1874627643068928:0@lo:502: 00000100:00100000:1.0:1787784365.432450:0:7910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.432499:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643068928 00000100:00100000:0.0:1787784365.432505:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643068928 00000100:00100000:1.0:1787784365.432507:0:7910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.432548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787784365.432556:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:7910:x1874627643068928:12345-0@lo:502: 00000100:00100000:0.0:1787784365.433071:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:7910:x1874627643068928:12345-0@lo:502: Request processed in 513us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.433078:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787784365.434683:0:7910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7910:1874627643068928:0@lo:502: 00000040:00080000:3.0:1787784365.434749:0:7910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787784365.434983:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787784365.435008:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784365.435023:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.435036:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784365.435048:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787784365.435069:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff94318875c800 from 5 10000000:01000000:2.0:1787784365.435073:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787784365.435126:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.435136:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.435147:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784365.435232:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069056:0@lo:101: 00000100:00100000:2.0:1787784365.435316:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.435405:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.435829:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069056 00000100:00100000:0.0:1787784365.435838:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069056 00000100:00100000:0.0:1787784365.435905:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784365.435917:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643069056:12345-0@lo:101: 00010000:00010000:0.0:1787784365.435936:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784365.435954:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030600/0xffb8d925c20ba903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba8fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.435992:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030600/0xffb8d925c20ba903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba8fc expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.436005:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030600/0xffb8d925c20ba903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8fc expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784365.436015:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030600, rc 0) 00000100:00100000:0.0:1787784365.436066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643069056:12345-0@lo:101: Request processed in 151us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.436074:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787784365.436293:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069056:0@lo:101: 00010000:00010000:2.0:1787784365.436310:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.436320:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784365.436423:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069184:0@lo:256: 00000100:00100000:2.0:1787784365.436463:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.436501:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.437295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069184 00000100:00100000:0.0:1787784365.437305:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069184 00000100:00100000:0.0:1787784365.437399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787784365.437410:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643069184:12345-0@lo:256: 20000000:01000000:0.0:1787784365.437438:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784365.437480:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784365.437485:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787784365.437598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643069184:12345-0@lo:256: Request processed in 191us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.437607:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784365.437790:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069184:0@lo:256: 10000000:01000000:2.0:1787784365.437854:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787784365.437865:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.437886:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784365.437896:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787784365.437899:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787784365.437901:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784365.437950:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.437958:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.437967:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784365.437986:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069312:0@lo:101: 00000100:00100000:2.0:1787784365.438021:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.438050:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069312 00000100:00100000:2.0:1787784365.438054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069312 00000100:00100000:2.0:1787784365.438079:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787784365.438086:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643069312:12345-0@lo:101: 00010000:00010000:2.0:1787784365.438098:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784365.438112:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba90a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.438139:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.439881:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.439918:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0400, rc 0) 00000100:00100000:2.0:1787784365.439994:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643069312:12345-0@lo:101: Request processed in 1906us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.440002:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787784365.440061:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.440083:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069312:0@lo:101: 00010000:00010000:2.0:1787784365.440107:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784365.440116:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784365.441403:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069440:0@lo:501: 00000100:00100000:3.0:1787784365.441497:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784365.441538:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.441751:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069440 00000100:00100000:2.0:1787784365.441759:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069440 00000100:00100000:2.0:1787784365.441809:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787784365.441820:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643069440:12345-0@lo:501: 00000100:00100000:2.0:1787784365.442121:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643069440:12345-0@lo:501: Request processed in 303us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.442129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787784365.442156:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069440:0@lo:501: 00000100:00100000:3.0:1787784365.442210:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069568:0@lo:503: 00000100:00100000:3.0:1787784365.443350:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784365.443411:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069568 00000100:00100000:3.0:1787784365.443419:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069568 00000100:00100000:3.0:1787784365.443464:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787784365.443485:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643069568:12345-0@lo:503: 00000100:00100000:3.0:1787784365.446443:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643069568:12345-0@lo:503: Request processed in 2876us (3014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784365.446463:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787784365.447244:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784365.447295:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643069568:0@lo:503: 00000100:00100000:3.0:1787784365.447993:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7912:1874627643069696:0@lo:502: 00000100:00100000:3.0:1787784365.448084:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784365.448132:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318691fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784365.448182:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069696 00000100:00100000:1.0:1787784365.448191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069696 00000100:00100000:1.0:1787784365.448261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787784365.448272:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:7912:x1874627643069696:12345-0@lo:502: 00000100:00100000:1.0:1787784365.448964:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:7912:x1874627643069696:12345-0@lo:502: Request processed in 693us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784365.448973:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787784365.454712:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7912:1874627643069696:0@lo:502: 00000020:01000000:0.0:1787784365.454789:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784365.454799:0:7912:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787784365.454813:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784365.454816:0:7912:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787784365.454822:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787784365.454827:0:7912:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:0.0:1787784365.454879:0:7912:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787784365.454883:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784365.454904:0:7912:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9431885e0000) 00000020:00000080:0.0:1787784365.454935:0:7912:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787784365.454940:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787784365.455073:0:7912:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787784365.455081:0:7912:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787784365.455089:0:7912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20ba91f 00010000:00080000:0.0:1787784365.455126:0:7912:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431862bf000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1787784365.455443:0:7912:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787784365.455894:0:7912:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787784365.455913:0:7912:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787784365.458572:0:7912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784365.460094:0:7912:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784365.460786:0:7912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787784365.460883:0:7912:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787784365.465753:0:7914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784365.465769:0:7914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787784365.467048:0:7912:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784365.467074:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784365.467123:0:7912:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787784365.467291:0:7912:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20ba926 00000100:00080000:0.0:1787784365.467309:0:7912:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784365.467317:0:7912:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9431862bf000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784365.467609:0:7912:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431ba341e00 x1874627643069824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784365.467700:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643069824:0@lo:8: 00000100:00100000:2.0:1787784365.467802:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784365.467958:0:7912:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787784365.468032:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784365.468038:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784365.468040:0:7912:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787784365.468043:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784365.468047:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784365.468049:0:7912:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787784365.468068:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784365.468070:0:7912:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787784365.468100:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7912:1874627643069952:0@lo:502: 00000100:00100000:0.0:1787784365.468248:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.468278:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.469488:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069824 00000100:00100000:2.0:1787784365.469507:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069824 00000100:00100000:2.0:1787784365.469570:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784365.469601:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1874627643069824:12345-0@lo:8: 00000100:00100000:3.0:1787784365.469658:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643069952 00000100:00100000:3.0:1787784365.469664:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643069952 00000100:00100000:3.0:1787784365.469711:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787784365.469719:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:7912:x1874627643069952:12345-0@lo:502: 00000100:00100000:3.0:1787784365.470089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:7912:x1874627643069952:12345-0@lo:502: Request processed in 370us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784365.470106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787784365.470108:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1787784365.470147:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20ba92d 00002000:00100000:2.0:1787784365.470179:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9431b9daf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787784365.470185:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787784365.470190:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787784365.470344:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787784365.470581:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787784365.470616:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431b9dac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784365.470890:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3412c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:7912:1874627643069952:0@lo:502: 00000020:01000000:0.0:1787784365.470936:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784365.470945:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784365.470948:0:7912:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787784365.470954:0:7912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787784365.471250:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643069824:12345-0@lo:8: Request processed in 1650us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.471261:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784365.471392:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:01000000:1.0:1787784365.471437:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787784365.471494:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787784365.471510:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471522:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784365.471535:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787784365.471539:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431857819b8 from 1 10000000:01000000:1.0:1787784365.471543:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787784365.471586:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471607:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471619:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784365.471641:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643070336:0@lo:101: 00000100:00100000:1.0:1787784365.471696:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784365.471736:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784365.471755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070336 00000100:00100000:1.0:1787784365.471761:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070336 00000100:00100000:1.0:1787784365.471806:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787784365.471814:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643070336:12345-0@lo:101: 00010000:00010000:1.0:1787784365.471827:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784365.471842:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba934 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471872:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471884:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.471893:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0600, rc 0) 00000100:00100000:1.0:1787784365.471930:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643070336:12345-0@lo:101: Request processed in 117us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784365.471936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787784365.471979:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643070336:0@lo:101: 00010000:00010000:1.0:1787784365.472003:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.472013:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784365.472084:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643070464:0@lo:501: 00000100:00100000:1.0:1787784365.472109:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784365.472126:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784365.472139:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070464 00000100:00100000:1.0:1787784365.472143:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070464 00000100:00100000:1.0:1787784365.472164:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787784365.472170:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643070464:12345-0@lo:501: 00000100:00100000:1.0:1787784365.472502:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643070464:12345-0@lo:501: Request processed in 331us (391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784365.472511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787784365.472543:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643070464:0@lo:501: 10000000:01000000:1.0:1787784365.472578:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787784365.472586:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784365.472594:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784365.475919:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643070208:0@lo:400: 00000100:00100000:0.0:1787784365.476026:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.476094:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643070080:0@lo:400: 00000100:00100000:0.0:1787784365.476117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.476193:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070208 00000100:00100000:0.0:1787784365.476203:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070208 00000100:00100000:0.0:1787784365.476269:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070080 00000100:00100000:0.0:1787784365.476273:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070080 00000100:00100000:0.0:1787784365.476294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787784365.476302:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643070208:12345-0@lo:400: 00000100:00100000:0.0:1787784365.476391:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643070208:12345-0@lo:400: Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784365.476399:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787784365.476406:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784365.476417:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643070080:12345-0@lo:400: 00000100:00080000:0.0:1787784365.476422:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784365.476462:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643070080:12345-0@lo:400: Request processed in 49us (345us total) trans 0 rc 0/0 00010000:00080000:0.0:1787784365.476462:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40ed00 x1874627643070208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784365.476489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784365.476492:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643070208:0@lo:400: 00010000:00080000:0.0:1787784365.476512:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40da40 x1874627643070080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784365.476521:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643070080:0@lo:400: 00010000:00080000:0.0:1787784365.478989:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba341e00 x1874627643069824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784365.479009:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784365.479022:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787784365.479033:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787784365.479042:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787784365.479046:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431862bf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787784365.479072:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787784365.479080:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643069824:0@lo:8: 00000004:00080000:1.0:1787784365.479685:0:7914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787784365.479824:0:7914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 180306458460ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787784365.483607:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643070592:0@lo:400: 00000100:00100000:2.0:1787784365.483719:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.483792:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070592 00000100:00100000:2.0:1787784365.483802:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070592 00000100:00100000:2.0:1787784365.483873:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784365.483883:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643070592:12345-0@lo:400: 00000100:00100000:2.0:1787784365.483942:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643070592:12345-0@lo:400: Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.483948:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787784365.483973:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784365.484002:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643070592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784365.484018:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643070592:0@lo:400: 00000100:00100000:2.0:1787784365.484056:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643070720:0@lo:400: 00000100:00100000:2.0:1787784365.484094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.484126:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070720 00000100:00100000:2.0:1787784365.484130:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070720 00000100:00100000:2.0:1787784365.484180:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784365.484188:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643070720:12345-0@lo:400: 00000100:00100000:2.0:1787784365.484227:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643070720:12345-0@lo:400: Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.484233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787784365.484248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784365.484268:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643070720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784365.484277:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643070720:0@lo:400: 00000004:00080000:1.0:1787784365.558257:0:7915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787784365.558303:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643070976:0@lo:7: 00000100:00100000:1.0:1787784365.558603:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784365.558876:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318851a240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784365.558898:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643070848:0@lo:13: 00000100:00100000:1.0:1787784365.558934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784365.558991:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070976 00000100:00100000:1.0:1787784365.559001:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070976 00000100:00100000:1.0:1787784365.559076:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784365.559086:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7915:x1874627643070976:12345-0@lo:7: 00000004:00080000:3.0:1787784365.559330:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:3.0:1787784365.559413:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784365.559428:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643070848 00000100:00100000:3.0:1787784365.559433:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643070848 00000100:00100000:3.0:1787784365.559478:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784365.559488:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643070848:12345-0@lo:13: 00002000:00000024:3.0:1787784365.559518:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787784365.559600:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643070848:12345-0@lo:13: Request processed in 114us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784365.559607:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787784365.559757:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbad00 x1874627643070848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784365.559780:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643070848:0@lo:13: 00002000:00080000:1.0:1787784365.573093:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787784365.573105:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787784365.573241:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7915:x1874627643070976:12345-0@lo:7: Request processed in 14150us (14633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784365.573254:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787784365.574914:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fb9a40 x1874627643070976/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787784381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784365.574938:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643070976:0@lo:7: 00000004:00080000:0.0:1787784365.574958:0:7915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787784365.575103:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071104:0@lo:5: 00000100:00100000:0.0:1787784365.575178:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.575237:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.575676:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071104 00000100:00100000:2.0:1787784365.575686:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071104 00000100:00100000:2.0:1787784365.575746:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784365.575757:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7915:x1874627643071104:12345-0@lo:5: 00002000:00080000:2.0:1787784365.575793:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787784365.575798:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787784365.577504:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7915:x1874627643071104:12345-0@lo:5: Request processed in 1740us (2317us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787784365.577518:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787784365.580240:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba341e00 x1874627643071104/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784365.580301:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071104:0@lo:5: 00000004:00080000:0.0:1787784365.580321:0:7915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787784365.580406:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071232:0@lo:700: 00000100:00100000:0.0:1787784365.580499:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784365.580550:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784365.580729:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071232 00000100:00100000:2.0:1787784365.580738:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071232 00000100:00100000:2.0:1787784365.580814:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784365.580825:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7915:x1874627643071232:12345-0@lo:700: 00000100:00100000:2.0:1787784365.580875:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1874627643071360:0@lo:700: 00000100:00100000:2.0:1787784365.580910:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.580966:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318654b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784365.584483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071360 00000100:00100000:1.0:1787784365.584506:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071360 00000100:00100000:1.0:1787784365.584594:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784365.584606:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1874627643071360:12345-0@lo:700: 40000000:02000000:1.0:1787784365.656152:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787784365.661913:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1874627643071360:12345-0@lo:700: Request processed in 77294us (80987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784365.661934:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787784365.664330:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643071360/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787784381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784365.664355:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1874627643071360:0@lo:700: 40000000:02000000:3.0:1787784365.664389:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1787784365.688731:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784365.746007:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7915:x1874627643071232:12345-0@lo:700: Request processed in 165171us (165494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784365.746039:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1787784365.746102:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787784365.746113:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787784365.746164:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba340780 x1874627643071232/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787784381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784365.746184:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071232:0@lo:700: 00000004:02000040:2.0:1787784365.779831:0:7915:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787784365.787488:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071488:0@lo:5: 00000100:00100000:2.0:1787784365.787582:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784365.787647:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b44f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784365.787777:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071488 00000100:00100000:0.0:1787784365.787787:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071488 00000100:00100000:0.0:1787784365.787862:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784365.787874:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7915:x1874627643071488:12345-0@lo:5: 00002000:00080000:0.0:1787784365.813929:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787784365.813959:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787784365.833334:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7915:x1874627643071488:12345-0@lo:5: Request processed in 45447us (45737us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787784365.833353:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787784365.834404:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643071488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784365.834425:0:7915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787784365.834445:0:7915:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9431bf40fc00 x1874627643071488/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787784381 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784365.834459:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874627643071488:0@lo:5: 00000004:00080000:2.0:1787784365.834490:0:7915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787784366.709082:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784366.819156:0:7980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787784367.738730:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784368.756777:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784368.948577:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784368.948620:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643071616:0@lo:13: 00000100:00100000:2.0:1787784368.948727:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784368.948920:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071616 00000100:00100000:3.0:1787784368.948931:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071616 00000100:00100000:3.0:1787784368.949021:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784368.949033:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643071616:12345-0@lo:13: 00002000:00000024:3.0:1787784368.949082:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784368.949142:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643071616:12345-0@lo:13: Request processed in 111us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784368.949150:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787784368.949248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784368.949303:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a43c0 x1874627643071616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784368.949326:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643071616:0@lo:13: 00010000:00010000:2.0:1787784369.780777:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784370.484602:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643071872:0@lo:400: 00000100:00100000:2.0:1787784370.484673:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784370.484725:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643072384:0@lo:400: 00000100:00100000:1.0:1787784370.484728:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643071744:0@lo:400: 00000100:00100000:2.0:1787784370.484757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784370.484778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784370.484813:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643072000:0@lo:400: 00000100:00100000:1.0:1787784370.484816:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643072256:0@lo:400: 00000100:00100000:2.0:1787784370.484851:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784370.484863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071744 00000100:00100000:1.0:1787784370.484872:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071744 00000100:00100000:2.0:1787784370.484878:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784370.484886:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643072128:0@lo:400: 00000100:00100000:2.0:1787784370.484912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784370.484919:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787784370.484931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643071744:12345-0@lo:400: 00000100:00100000:2.0:1787784370.484947:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643071872 00000100:00100000:2.0:1787784370.484952:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643071872 00000100:00100000:1.0:1787784370.484982:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643071744:12345-0@lo:400: Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784370.484991:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787784370.485003:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072000 00000100:00100000:2.0:1787784370.485007:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072000 00000100:00100000:2.0:1787784370.485039:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784370.485046:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643071872:12345-0@lo:400: 00000100:00100000:0.0:1787784370.485068:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072384 00000100:00100000:0.0:1787784370.485073:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072384 00000100:00100000:2.0:1787784370.485098:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643071872:12345-0@lo:400: Request processed in 52us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784370.485106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784370.485111:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072128 00000100:00100000:0.0:1787784370.485116:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072128 00000100:00100000:2.0:1787784370.485125:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784370.485135:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643072000:12345-0@lo:400: 00000100:00100000:0.0:1787784370.485141:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784370.485152:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643072384:12345-0@lo:400: 00000100:00100000:2.0:1787784370.485176:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197017840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643072000:12345-0@lo:400: Request processed in 43us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784370.485198:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643072384:12345-0@lo:400: Request processed in 48us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784370.485199:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784370.485210:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784370.485231:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787784370.485289:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40d2c0 x1874627643071872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784370.485304:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643071872:0@lo:400: 00010000:00080000:1.0:1787784370.485316:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431970143c0 x1874627643072384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784370.485325:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431970143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643072384:0@lo:400: 00000100:00100000:0.0:1787784370.485405:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643072128:12345-0@lo:400: 00000100:00100000:0.0:1787784370.485449:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643072128:12345-0@lo:400: Request processed in 48us (537us total) trans 0 rc 0/0 00000100:00080000:2.0:1787784370.487296:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784370.487307:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784370.487311:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787784370.487381:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40ed00 x1874627643072128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784370.487402:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643072128:0@lo:400: 00010000:00080000:2.0:1787784370.487613:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40e1c0 x1874627643072000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784370.487623:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643072000:0@lo:400: 00000100:00100000:2.0:1787784370.487665:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784370.487726:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643071744:0@lo:400: 00000100:00100000:1.0:1787784370.487738:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072256 00000100:00100000:1.0:1787784370.487746:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072256 00000100:00080000:2.0:1787784370.487792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784370.487819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784370.487830:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643072256:12345-0@lo:400: 00000100:00100000:1.0:1787784370.487909:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431970143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643072256:12345-0@lo:400: Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784370.487917:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787784370.487950:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40c780 x1874627643072256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784370.487974:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643072256:0@lo:400: 00000100:00100000:0.0:1787784370.492539:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787784370.809411:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784370.997653:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784370.997677:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643072512:0@lo:13: 00000100:00100000:0.0:1787784370.997750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784370.997892:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072512 00000100:00100000:1.0:1787784370.997900:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072512 00000100:00100000:1.0:1787784370.997949:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784370.997957:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643072512:12345-0@lo:13: 00002000:00000024:1.0:1787784370.997994:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784370.998044:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643072512:12345-0@lo:13: Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784370.998051:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787784370.998086:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fb8f00 x1874627643072512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784370.998103:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643072512:0@lo:13: 00000001:00080000:1.0:1787784371.125904:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787784371.829097:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784372.876314:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784373.753732:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.753850:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634659456 00000100:00100000:3.0:1787784373.753860:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634659456 00000100:00100000:3.0:1787784373.753916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:3.0:1787784373.753924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874627634659456:12345-192.168.202.59@tcp:250: 00010000:00080000:3.0:1787784373.753954:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from db7e8534-d8e1-4743-9795-d099e9d1ca8f@192.168.202.59@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1787784373.753982:0:5826:0:(genops.c:1385:class_connect()) connect: client db7e8534-d8e1-4743-9795-d099e9d1ca8f, cookie 0xffb8d925c20ba942 00000100:00080000:3.0:1787784373.754125:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784373.754204:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+5:2361:x1874627634659456:12345-192.168.202.59@tcp:250: Request processed in 279us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.754212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:3.0:1787784373.756285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784373.756414:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634659584 00000100:00100000:2.0:1787784373.756427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634659584 00000100:00100000:2.0:1787784373.759041:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:2.0:1787784373.759068:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+5:5594:x1874627634659584:12345-192.168.202.59@tcp:101: 00010000:00010000:2.0:1787784373.759088:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784373.759109:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a840 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.759144:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.759156:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.759183:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0a00, rc 0) 00000100:00100000:2.0:1787784373.759266:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+6:5594:x1874627634659584:12345-192.168.202.59@tcp:101: Request processed in 211us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784373.759274:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1787784373.771478:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.771552:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634659712 00000100:00100000:3.0:1787784373.771563:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634659712 00000100:00100000:3.0:1787784373.771631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:3.0:1787784373.771641:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+6:5594:x1874627634659712:12345-192.168.202.59@tcp:501: 00000100:00100000:3.0:1787784373.772023:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+6:5594:x1874627634659712:12345-192.168.202.59@tcp:501: Request processed in 382us (553us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784373.772033:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:1.0:1787784373.784081:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784373.784174:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634659840 00000100:00100000:0.0:1787784373.784185:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634659840 00000100:00100000:0.0:1787784373.784245:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:0.0:1787784373.784256:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+6:5594:x1874627634659840:12345-192.168.202.59@tcp:101: 00010000:00010000:0.0:1787784373.784273:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784373.784291:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a847 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784373.784321:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784373.784334:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784373.784345:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030000, rc 0) 00000100:00100000:0.0:1787784373.784473:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+7:5594:x1874627634659840:12345-192.168.202.59@tcp:101: Request processed in 219us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784373.784480:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:3.0:1787784373.790850:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.790885:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634659968 00000100:00100000:3.0:1787784373.790895:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634659968 00000100:00100000:3.0:1787784373.790953:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:3.0:1787784373.790963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+7:5594:x1874627634659968:12345-192.168.202.59@tcp:501: 00000100:00100000:3.0:1787784373.791268:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5594:x1874627634659968:12345-192.168.202.59@tcp:501: Request processed in 305us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.791276:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:0.0:1787784373.805353:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.805469:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660096 00000100:00100000:3.0:1787784373.805480:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660096 00000100:00100000:3.0:1787784373.805531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:3.0:1787784373.805540:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5594:x1874627634660096:12345-192.168.202.59@tcp:503: 00000100:00100000:3.0:1787784373.805910:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5594:x1874627634660096:12345-192.168.202.59@tcp:503: Request processed in 370us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.805919:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:3.0:1787784373.822515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784373.822623:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660224 00000100:00100000:0.0:1787784373.822635:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660224 00000100:00100000:0.0:1787784373.822706:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:0.0:1787784373.822717:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5614:x1874627634660224:12345-192.168.202.59@tcp:502: 00000100:00100000:0.0:1787784373.823104:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5614:x1874627634660224:12345-192.168.202.59@tcp:502: Request processed in 387us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784373.823112:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:3.0:1787784373.876919:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.876966:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660352 00000100:00100000:3.0:1787784373.876976:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660352 00000100:00100000:3.0:1787784373.877024:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:3.0:1787784373.877034:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5614:x1874627634660352:12345-192.168.202.59@tcp:502: 00000100:00100000:3.0:1787784373.877291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5614:x1874627634660352:12345-192.168.202.59@tcp:502: Request processed in 257us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.877299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00010000:00010000:1.0:1787784373.878250:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784373.883299:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.883412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660480 00000100:00100000:3.0:1787784373.883424:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660480 00000100:00100000:3.0:1787784373.883479:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:3.0:1787784373.883490:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5594:x1874627634660480:12345-192.168.202.59@tcp:101: 00010000:00010000:3.0:1787784373.883507:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784373.883525:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181513200/0xffb8d925c20ba957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a871 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784373.883552:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181513200/0xffb8d925c20ba957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a871 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784373.883564:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181513200/0xffb8d925c20ba957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a871 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784373.883591:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513200, rc 0) 00000100:00100000:3.0:1787784373.883651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5594:x1874627634660480:12345-192.168.202.59@tcp:101: Request processed in 162us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.883657:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:3.0:1787784373.886566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784373.886714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660608 00000100:00100000:0.0:1787784373.886724:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660608 00000100:00100000:0.0:1787784373.886780:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1787784373.886791:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5594:x1874627634660608:12345-192.168.202.59@tcp:256: 20000000:01000000:0.0:1787784373.886819:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784373.886842:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784373.886847:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784373.886850:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784373.886852:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787784373.890638:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5594:x1874627634660608:12345-192.168.202.59@tcp:256: Request processed in 3838us (4073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784373.892785:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1787784373.896206:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784373.896281:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660736 00000100:00100000:2.0:1787784373.896291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660736 00000100:00100000:2.0:1787784373.896345:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:2.0:1787784373.896356:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5594:x1874627634660736:12345-192.168.202.59@tcp:101: 00010000:00010000:2.0:1787784373.896412:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784373.896433:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a878 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.896464:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.896476:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784373.896485:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1800, rc 0) 00000100:00100000:2.0:1787784373.896540:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5594:x1874627634660736:12345-192.168.202.59@tcp:101: Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784373.896547:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:3.0:1787784373.903069:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784373.903168:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660864 00000100:00100000:1.0:1787784373.903179:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660864 00000100:00100000:1.0:1787784373.903240:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:1.0:1787784373.903252:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5594:x1874627634660864:12345-192.168.202.59@tcp:501: 00000100:00100000:1.0:1787784373.903621:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5594:x1874627634660864:12345-192.168.202.59@tcp:501: Request processed in 370us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784373.903638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:3.0:1787784373.905220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784373.905290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634660992 00000100:00100000:1.0:1787784373.905298:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634660992 00000100:00100000:1.0:1787784373.905343:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:1.0:1787784373.905351:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5594:x1874627634660992:12345-192.168.202.59@tcp:503: 00000100:00100000:1.0:1787784373.906106:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5594:x1874627634660992:12345-192.168.202.59@tcp:503: Request processed in 751us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784373.906116:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:0.0:1787784373.909998:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784373.910083:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661120 00000100:00100000:1.0:1787784373.910094:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661120 00000100:00100000:1.0:1787784373.910157:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:1.0:1787784373.910169:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5620:x1874627634661120:12345-192.168.202.59@tcp:502: 00000100:00100000:1.0:1787784373.910502:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5620:x1874627634661120:12345-192.168.202.59@tcp:502: Request processed in 334us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784373.910511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:0.0:1787784373.923900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784373.924040:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661248 00000100:00100000:3.0:1787784373.924050:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661248 00000100:00100000:3.0:1787784373.924105:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:3.0:1787784373.924115:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5620:x1874627634661248:12345-192.168.202.59@tcp:502: 00000100:00100000:3.0:1787784373.924330:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5620:x1874627634661248:12345-192.168.202.59@tcp:502: Request processed in 216us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784373.924338:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:0.0:1787784373.930609:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784373.930816:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661376 00000100:00100000:1.0:1787784373.930828:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661376 00000100:00100000:1.0:1787784373.930878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784373.930887:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874627634661376:12345-192.168.202.59@tcp:38: 00010000:00080000:1.0:1787784373.930918:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1787784373.930983:0:5831:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20ba965 00000004:00100000:1.0:1787784373.931018:0:5831:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:1.0:1787784373.931025:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787784373.981483:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9431b9881000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784373.981580:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634661376:12345-192.168.202.59@tcp:38: Request processed in 50692us (50983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784373.981601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784374.073705:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643072640:0@lo:13: 00000100:00100000:1.0:1787784374.073774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784374.074651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072640 00000100:00100000:3.0:1787784374.074666:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072640 00000100:00100000:3.0:1787784374.074736:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784374.074745:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643072640:12345-0@lo:13: 00002000:00000024:3.0:1787784374.074783:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787784374.074963:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784374.078988:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643072640:12345-0@lo:13: Request processed in 4233us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784374.079006:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787784374.079788:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943189160f00 x1874627643072640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784374.079815:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643072640:0@lo:13: 00000100:00100000:3.0:1787784374.487956:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784374.488021:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784374.488160:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661632 00000100:00100000:1.0:1787784374.488175:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661632 00000100:00100000:1.0:1787784374.488270:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661504 00000100:00100000:1.0:1787784374.488274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661504 00000100:00100000:1.0:1787784374.488297:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784374.488307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:5594:x1874627634661632:12345-192.168.202.59@tcp:41: 00000004:00000024:1.0:1787784374.488353:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787784374.488504:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:5594:x1874627634661632:12345-192.168.202.59@tcp:41: Request processed in 198us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784374.488512:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784374.488537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784374.488545:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:0:x1874627634661504:12345-192.168.202.59@tcp:41: 00000004:00000024:1.0:1787784374.488560:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787784374.488588:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:0:x1874627634661504:12345-192.168.202.59@tcp:41: Request processed in 43us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784374.488595:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00080000:2.0:1787784374.491808:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784374.503261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784374.506495:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661760 00000100:00100000:0.0:1787784374.506520:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661760 00000100:00100000:0.0:1787784374.506641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784374.506664:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5594:x1874627634661760:12345-192.168.202.59@tcp:40: 00000100:00100000:0.0:1787784374.506895:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5594:x1874627634661760:12345-192.168.202.59@tcp:40: Request processed in 234us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784374.506948:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784374.522109:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784374.522203:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784374.522498:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662272 00000100:00100000:1.0:1787784374.522512:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662272 00000100:00100000:1.0:1787784374.522605:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:1.0:1787784374.522631:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634662272:12345-192.168.202.59@tcp:400: 00000100:00100000:2.0:1787784374.522660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662144 00000100:00100000:2.0:1787784374.522672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662144 00000100:00100000:2.0:1787784374.522716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784374.522724:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5594:x1874627634662144:12345-192.168.202.59@tcp:33: 00000100:00100000:1.0:1787784374.522735:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634662272:12345-192.168.202.59@tcp:400: Request processed in 108us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784374.522742:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:0.0:1787784374.527815:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784374.527863:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784374.527908:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634661888 00000100:00100000:0.0:1787784374.527924:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634661888 00000100:00100000:0.0:1787784374.527976:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662016 00000100:00100000:0.0:1787784374.527979:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662016 00000100:00100000:0.0:1787784374.527997:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784374.528009:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874627634661888:12345-192.168.202.59@tcp:8: 00010000:00080000:0.0:1787784374.528057:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1787784374.528105:0:6678:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20ba96c 00002000:00100000:0.0:1787784374.528124:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9a4fd2c-0c67-4cd1-a267-69f5c190cff9/ffff9431862bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784374.528141:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784374.533001:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784374.533072:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431862b8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784374.533196:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634661888:12345-192.168.202.59@tcp:8: Request processed in 5187us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784374.533210:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784374.533253:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784374.533262:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba341680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874627634662016:12345-192.168.202.59@tcp:8: 00010000:00080000:0.0:1787784374.533299:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1787784374.533335:0:6678:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20ba973 00002000:00100000:0.0:1787784374.533352:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f9a4fd2c-0c67-4cd1-a267-69f5c190cff9/ffff9431862be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784374.533435:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784374.533708:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784374.533728:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431862b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784374.533772:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba341680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634662016:12345-192.168.202.59@tcp:8: Request processed in 510us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784374.533779:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000004:00080000:0.0:1787784374.576758:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 53955us 00000004:00200000:1.0:1787784374.638127:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787784374.639057:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5594:x1874627634662144:12345-192.168.202.59@tcp:33: Request processed in 116321us (116953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784374.639080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00010000:00010000:1.0:1787784374.900726:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784375.011470:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784375.011626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662400 00000100:00100000:3.0:1787784375.011662:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662400 00000100:00100000:3.0:1787784375.011748:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784375.011761:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5637:x1874627634662400:12345-192.168.202.59@tcp:101: 00010000:00010000:3.0:1787784375.011792:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784375.013428:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20ba97a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a8a2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013530:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013546:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013570:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784375.013790:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787784375.013795:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784375.013873:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013902:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20ba97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a2 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013922:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a2 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784375.013931:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784375.013934:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784375.013938:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512000, rc 0) 00000100:00100000:3.0:1787784375.014270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:5637:x1874627634662400:12345-192.168.202.59@tcp:101: Request processed in 2510us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784375.014280:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784375.605102:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784375.608164:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643072896:0@lo:400: 00000100:00100000:0.0:1787784375.608267:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784375.608348:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643072768:0@lo:400: 00000100:00100000:0.0:1787784375.608428:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784375.608844:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072768 00000100:00100000:2.0:1787784375.608855:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072768 00000100:00100000:2.0:1787784375.608915:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787784375.608925:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643072768:12345-0@lo:400: 00000100:00100000:3.0:1787784375.609021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643072896 00000100:00100000:3.0:1787784375.609026:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643072896 00000100:00100000:3.0:1787784375.609060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784375.609067:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643072896:12345-0@lo:400: 00000100:00100000:1.0:1787784375.609212:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784375.609224:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643073024:0@lo:400: 00000100:00100000:0.0:1787784375.609323:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784375.609330:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643073280:0@lo:400: 00000100:00100000:2.0:1787784375.612889:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643072768:12345-0@lo:400: Request processed in 3955us (4449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784375.612906:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787784375.612965:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784375.612986:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073152:0@lo:400: 00000100:00100000:2.0:1787784375.613027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784375.613226:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784375.613235:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643073408:0@lo:400: 00000100:00100000:2.0:1787784375.613262:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784375.613303:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073152 00000100:00100000:2.0:1787784375.613310:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073152 00000100:00100000:2.0:1787784375.613348:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073408 00000100:00100000:2.0:1787784375.613351:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073408 00000100:00100000:2.0:1787784375.613411:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784375.613419:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073152:12345-0@lo:400: 00000100:00100000:3.0:1787784375.613606:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643072896:12345-0@lo:400: Request processed in 4537us (5337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784375.613615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787784375.613658:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784375.613676:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784375.613683:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787784375.613838:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784375.613846:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643073408:12345-0@lo:400: 00000100:00100000:3.0:1787784375.613882:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643073408:12345-0@lo:400: Request processed in 37us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784375.613889:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787784375.613995:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943189162580 x1874627643073408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784375.614005:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787784375.614021:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643073408:0@lo:400: 00000100:00100000:2.0:1787784375.614172:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073152:12345-0@lo:400: Request processed in 753us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784375.614179:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787784375.615963:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba341e00 x1874627643073152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784375.615982:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073152:0@lo:400: 00000100:00100000:1.0:1787784375.616098:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784375.616190:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073024 00000100:00100000:3.0:1787784375.616211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073024 00000100:00100000:3.0:1787784375.616269:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784375.616276:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643073024:12345-0@lo:400: 00000100:00100000:3.0:1787784375.616336:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643073024:12345-0@lo:400: Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784375.616342:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787784375.616428:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784375.616463:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643073024:0@lo:400: 00000100:00100000:0.0:1787784375.621244:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784375.621402:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643072896:0@lo:400: 00000100:00100000:0.0:1787784375.621418:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643072768:0@lo:400: 00000100:00100000:3.0:1787784375.631940:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073280 00000100:00100000:3.0:1787784375.631956:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073280 00000100:00100000:3.0:1787784375.632032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784375.632041:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643073280:12345-0@lo:400: 00000100:00100000:3.0:1787784375.632135:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643073280:12345-0@lo:400: Request processed in 95us (10898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784375.632142:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787784375.632347:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784375.632419:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643073280:0@lo:400: 00010000:00010000:1.0:1787784375.926687:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784376.116868:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073536:0@lo:13: 00000100:00100000:3.0:1787784376.116951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784376.117073:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073536 00000100:00100000:0.0:1787784376.117082:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073536 00000100:00100000:0.0:1787784376.117144:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784376.117154:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073536:12345-0@lo:13: 00002000:00000024:0.0:1787784376.117180:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784376.123909:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073536:12345-0@lo:13: Request processed in 6746us (6946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784376.123955:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787784376.127951:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbb840 x1874627643073536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784376.127982:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073536:0@lo:13: 00000001:00100000:1.0:1787784376.725158:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00010000:00010000:1.0:1787784376.948740:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784377.275690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784377.277035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662528 00000100:00100000:2.0:1787784377.277052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662528 00000100:00100000:2.0:1787784377.277147:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1787784377.277176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:5689:x1874627634662528:12345-192.168.202.59@tcp:41: 00000004:00000024:2.0:1787784377.277243:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787784377.277337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:5689:x1874627634662528:12345-192.168.202.59@tcp:41: Request processed in 165us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784377.277346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:0.0:1787784377.277516:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784377.282293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784377.282587:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662656 00000100:00100000:2.0:1787784377.282600:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662656 00000100:00100000:2.0:1787784377.282742:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1787784377.282756:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:5689:x1874627634662656:12345-192.168.202.59@tcp:13: 00002000:00000024:2.0:1787784377.282803:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784377.282887:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:5689:x1874627634662656:12345-192.168.202.59@tcp:13: Request processed in 135us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784377.282897:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00080000:0.0:1787784377.283635:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784377.289214:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784377.289494:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662784 00000100:00100000:2.0:1787784377.289505:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662784 00000100:00100000:2.0:1787784377.289586:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784377.289599:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5689:x1874627634662784:12345-192.168.202.59@tcp:13: 00002000:00000024:2.0:1787784377.289646:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784377.289720:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:5689:x1874627634662784:12345-192.168.202.59@tcp:13: Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784377.289728:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00080000:0.0:1787784377.291057:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787784377.972495:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784378.998118:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784379.192544:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784379.192588:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073664:0@lo:13: 00000100:00100000:2.0:1787784379.193034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784379.193149:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073664 00000100:00100000:2.0:1787784379.193159:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073664 00000100:00100000:2.0:1787784379.197068:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784379.197093:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073664:12345-0@lo:13: 00002000:00000024:2.0:1787784379.197164:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784379.197285:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643073664:12345-0@lo:13: Request processed in 199us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784379.197294:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787784379.197389:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943189161e00 x1874627643073664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784379.197419:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643073664:0@lo:13: 00000100:00080000:3.0:1787784379.197922:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787784379.294552:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000001:00100000:2.0:1787784379.301150:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000100:00100000:3.0:1787784379.647699:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784379.647748:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784379.647783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784379.647809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784379.647847:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663296 00000100:00100000:3.0:1787784379.647861:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663296 00000100:00100000:3.0:1787784379.647945:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663168 00000100:00100000:3.0:1787784379.647956:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663168 00000100:00100000:3.0:1787784379.647993:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784379.648006:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634663296:12345-192.168.202.59@tcp:400: 00000100:00100000:3.0:1787784379.648111:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634663296:12345-192.168.202.59@tcp:400: Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784379.648119:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784379.648141:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1787784379.648148:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634663168:12345-192.168.202.59@tcp:400: 00000100:00100000:3.0:1787784379.648175:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634663168:12345-192.168.202.59@tcp:400: Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784379.648181:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1787784379.648201:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634662912 00000100:00100000:3.0:1787784379.648204:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634662912 00000100:00100000:3.0:1787784379.648231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:3.0:1787784379.648236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2363:x1874627634662912:12345-192.168.202.59@tcp:400: 00000100:00100000:3.0:1787784379.648262:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2363:x1874627634662912:12345-192.168.202.59@tcp:400: Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784379.648269:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00080000:1.0:1787784379.648273:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784379.648279:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784379.648394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663040 00000100:00100000:2.0:1787784379.648400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663040 00000100:00100000:2.0:1787784379.648446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:2.0:1787784379.648454:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634663040:12345-192.168.202.59@tcp:400: 00000100:00100000:2.0:1787784379.648491:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634663040:12345-192.168.202.59@tcp:400: Request processed in 39us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784379.648498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00080000:0.0:1787784379.650277:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784380.034639:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784380.661512:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787784380.737291:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643073792:0@lo:400: 00000100:00100000:1.0:1787784380.737426:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737509:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643074304:0@lo:400: 00000100:00100000:1.0:1787784380.737542:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737577:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784380.737582:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643073920:0@lo:400: 00000100:00100000:1.0:1787784380.737625:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737644:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643074432:0@lo:400: 00000100:00100000:1.0:1787784380.737674:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737706:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643074048:0@lo:400: 00000100:00100000:1.0:1787784380.737731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737753:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784380.737759:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074176:0@lo:400: 00000100:00100000:1.0:1787784380.737780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784380.737817:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073792 00000100:00100000:1.0:1787784380.737828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073792 00000100:00100000:1.0:1787784380.738103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787784380.738116:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643073792:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738181:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643073792:12345-0@lo:400: Request processed in 68us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787784380.738230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074304 00000100:00100000:1.0:1787784380.738234:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074304 00000100:00100000:1.0:1787784380.738271:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643073920 00000100:00100000:1.0:1787784380.738274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643073920 00000100:00100000:1.0:1787784380.738286:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074048 00000100:00100000:1.0:1787784380.738289:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074048 00000100:00100000:1.0:1787784380.738304:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784380.738311:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643074304:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643074304:12345-0@lo:400: Request processed in 47us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784380.738414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784380.738420:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643073920:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738451:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643073920:12345-0@lo:400: Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738457:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784380.738468:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784380.738474:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643074048:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738507:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643074048:12345-0@lo:400: Request processed in 34us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738513:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784380.738538:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074432 00000100:00100000:1.0:1787784380.738542:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074432 00000100:00100000:1.0:1787784380.738572:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074176 00000100:00100000:1.0:1787784380.738575:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074176 00000100:00100000:1.0:1787784380.738690:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784380.738699:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643074432:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738734:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643074432:12345-0@lo:400: Request processed in 36us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738740:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784380.738752:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784380.738758:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074176:12345-0@lo:400: 00000100:00100000:1.0:1787784380.738787:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074176:12345-0@lo:400: Request processed in 30us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784380.738792:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787784380.738824:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784380.738838:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784380.739232:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fba580 x1874627643074176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784380.739251:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074176:0@lo:400: 00000100:00100000:1.0:1787784380.739269:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643074048:0@lo:400: 00000100:00100000:1.0:1787784380.739311:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643073920:0@lo:400: 00010000:00080000:1.0:1787784380.739324:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643074432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784380.739346:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643074432:0@lo:400: 00000100:00100000:1.0:1787784380.739357:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643073792:0@lo:400: 00000100:00100000:1.0:1787784380.739522:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643074304:0@lo:400: 00010000:00010000:1.0:1787784381.045112:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784381.237870:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074560:0@lo:13: 00000100:00100000:2.0:1787784381.238132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784381.240720:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074560 00000100:00100000:3.0:1787784381.240744:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074560 00000100:00100000:3.0:1787784381.240901:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784381.240914:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074560:12345-0@lo:13: 00002000:00000024:3.0:1787784381.240973:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784381.241080:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074560:12345-0@lo:13: Request processed in 169us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784381.241088:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787784381.241218:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643074560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784381.241246:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074560:0@lo:13: 00010000:00010000:1.0:1787784382.070935:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784383.092593:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.119678:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784384.309072:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784384.309109:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074688:0@lo:13: 00000100:00100000:3.0:1787784384.309207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784384.309881:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643074688 00000100:00100000:0.0:1787784384.309893:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643074688 00000100:00100000:0.0:1787784384.309982:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784384.309994:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074688:12345-0@lo:13: 00002000:00000024:0.0:1787784384.310044:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784384.310118:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643074688:12345-0@lo:13: Request processed in 126us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784384.310126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787784384.310231:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784384.317827:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac6580 x1874627643074688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784384.317869:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643074688:0@lo:13: 00000020:00000080:3.0:1787784384.732109:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb585460 20000000:00000080:3.0:1787784384.732132:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431bf455400 uarg=0000000000000000 20000000:01000000:3.0:1787784384.732184:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787784384.732188:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787784384.732191:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787784384.732197:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787784384.732204:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787784384.732221:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787784384.732225:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787784384.732716:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787784384.732720:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787784384.733553:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787784384.734645:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787784384.734734:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787784384.734772:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787784384.734788:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787784384.734791:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787784384.744743:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787784384.746603:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787784384.746677:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787784384.746733:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787784384.746756:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787784384.746759:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787784384.750807:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787784384.752010:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787784384.752093:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787784384.752134:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787784384.752154:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787784384.752157:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787784384.753511:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787784384.754031:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787784384.754103:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787784384.754144:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787784384.754162:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787784384.754194:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754220:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754230:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754419:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754427:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754435:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754444:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754453:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754465:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754473:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754482:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754537:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754560:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 9 pid: 5823 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.754593:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643074816:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784384.754742:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754751:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.754761:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643074944:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784384.754796:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754806:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 18 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.754816:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075072:0@lo:104: 00000100:00100000:3.0:1787784384.754871:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784384.754925:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.754934:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.754943:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075200:0@lo:104: 00000100:00100000:3.0:1787784384.754970:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784384.754995:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.755004:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.755020:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075328:0@lo:104: 00010000:00010000:3.0:1787784384.755049:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.755057:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.755067:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075456:0@lo:104: 00010000:00010000:3.0:1787784384.755092:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.755100:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 18 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.755108:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075584:0@lo:104: 00010000:00010000:3.0:1787784384.755133:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.755141:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.755150:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075712:0@lo:104: 00010000:00010000:3.0:1787784384.755180:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784384.755180:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1787784384.755189:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 18 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.755215:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075840:0@lo:104: 00000100:00100000:2.0:1787784384.755216:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784384.755240:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784384.755250:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784384.755258:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784384.755268:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075072 00000100:00100000:2.0:1787784384.755276:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075072 00000100:00100000:2.0:1787784384.755333:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075200 00000100:00100000:2.0:1787784384.755337:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075200 00000100:00100000:2.0:1787784384.755348:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075328 00000100:00100000:2.0:1787784384.755351:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075328 00000100:00100000:2.0:1787784384.755361:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075456 00000100:00100000:2.0:1787784384.755393:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075456 00000100:00100000:0.0:1787784384.755399:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075584 00000100:00100000:0.0:1787784384.755406:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075584 00000100:00100000:2.0:1787784384.755410:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075712 00000100:00100000:2.0:1787784384.755415:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075712 00000100:00100000:0.0:1787784384.755442:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784384.755463:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:8437:x1874627643075072:12345-0@lo:104: 00010000:00010000:0.0:1787784384.755478:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.755540:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784384.755547:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:8437:x1874627643075072:12345-0@lo:104: Request processed in 89us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784384.755611:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784384.755634:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784384.755663:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075072:0@lo:104: 00000100:00100000:2.0:1787784384.759338:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787784384.759367:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1787784384.759574:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784384.759610:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.759626:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784384.759631:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.759644:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784384.759654:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784384.759660:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787784384.759743:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.759751:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784384.759783:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.759791:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20ba934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba93b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.759814:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784384.759816:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784384.759819:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784384.759844:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643075968:0@lo:103: 00000100:00100000:1.0:1787784384.759939:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784384.759959:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075840 00000100:00100000:2.0:1787784384.759969:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075840 00000100:00100000:1.0:1787784384.760026:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643075968 00000100:00100000:1.0:1787784384.760031:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643075968 00010000:00010000:1.0:1787784384.760071:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.760101:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784384.760111:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643075968:12345-0@lo:103: 00010000:00010000:1.0:1787784384.760128:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784384.760134:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.760147:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784384.760162:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787784384.760168:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0600/0xffb8d925c20ba93b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba934 expref: 19 pid: 5826 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.760185:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784384.760226:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3293:x1874627643075968:12345-0@lo:103: Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.760240:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187768450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:8437:x1874627643075200:12345-0@lo:104: 00010000:00010000:2.0:1787784384.760254:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760343:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784384.760349:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187768450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+9:8437:x1874627643075200:12345-0@lo:104: Request processed in 116us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.760359:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784384.760362:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784384.760432:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643075968:0@lo:103: 00010000:00010000:2.0:1787784384.760462:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784384.760469:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760477:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784384.760487:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760497:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.760505:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.760512:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784384.760532:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760539:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.760562:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760569:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0000/0xffb8d925c20ba90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba911 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760579:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.760581:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.760583:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784384.760607:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784384.760618:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:8437:x1874627643075328:12345-0@lo:104: 00010000:00010000:2.0:1787784384.760627:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760663:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784384.760668:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+8:8437:x1874627643075328:12345-0@lo:104: Request processed in 55us (5457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.760680:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784384.760696:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784384.760704:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+7:8437:x1874627643075456:12345-0@lo:104: 00010000:00010000:2.0:1787784384.760712:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760750:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787784384.760755:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+7:8437:x1874627643075456:12345-0@lo:104: Request processed in 53us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.760760:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787784384.760772:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784384.760776:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760782:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180031800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784384.760785:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760791:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.760798:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.760803:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784384.760823:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760830:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.760861:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760869:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180031800/0xffb8d925c20ba8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8f5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760883:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784384.760886:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760894:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180031a00 already unused, calling callback (ffffffffc1c19c20) 00000100:00100000:3.0:1787784384.760898:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 10000000:00010000:2.0:1787784384.760900:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760909:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.760916:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.760922:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787784384.760930:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1787784384.760939:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760947:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.760954:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784384.760963:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1787784384.760966:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180031a00/0xffb8d925c20ba8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8e7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.760980:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.760988:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.760991:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784384.760997:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784384.761005:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663424 00000100:00100000:2.0:1787784384.761011:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663424 00000100:00100000:3.0:1787784384.761030:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1787784384.761036:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 10 pid: 5823 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784384.761058:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663552 00000100:00100000:2.0:1787784384.761061:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663552 00000100:00100000:3.0:1787784384.761075:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784384.761106:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663680 00000100:00100000:3.0:1787784384.761111:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663680 00000100:00100000:3.0:1787784384.761139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:3.0:1787784384.761147:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2364:x1874627634663680:12345-192.168.202.59@tcp:400: 00000100:00100000:3.0:1787784384.761210:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2364:x1874627634663680:12345-192.168.202.59@tcp:400: Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784384.761216:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:3.0:1787784384.762410:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643074816:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784384.762425:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643074944:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784384.762437:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075200:0@lo:104: 00000100:00100000:3.0:1787784384.762446:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075328:0@lo:104: 00000100:00100000:3.0:1787784384.762456:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075456:0@lo:104: 00010000:00010000:2.0:1787784384.762514:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 11 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784384.762543:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784384.762557:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:2362:x1874627634663424:12345-192.168.202.59@tcp:103: 00010000:00010000:2.0:1787784384.762573:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784384.762580:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 11 pid: 5823 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.762592:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663936 00000100:00100000:1.0:1787784384.762600:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663936 00010000:00010000:2.0:1787784384.762608:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 11 pid: 5823 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762630:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030000/0xffb8d925c20ba950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a847 expref: 11 pid: 5823 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762649:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784384.762650:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664064 00000100:00100000:1.0:1787784384.762655:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664064 00000100:00100000:1.0:1787784384.762684:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784384.762692:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2362:x1874627634663424:12345-192.168.202.59@tcp:103: Request processed in 139us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.762695:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634663936:12345-192.168.202.59@tcp:400: 00000100:00100000:2.0:1787784384.762708:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784384.762727:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784384.762735:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:2362:x1874627634663552:12345-192.168.202.59@tcp:103: 00010000:00010000:2.0:1787784384.762757:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784384.762762:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762770:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762778:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0a00/0xffb8d925c20ba949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a840 expref: 9 pid: 5825 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762785:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784384.762801:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:2362:x1874627634663552:12345-192.168.202.59@tcp:103: Request processed in 69us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.762808:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784384.762828:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784384.762835:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:8437:x1874627643075584:12345-0@lo:104: 00010000:00010000:2.0:1787784384.762845:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.762876:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634663936:12345-192.168.202.59@tcp:400: Request processed in 171us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.762894:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:2.0:1787784384.762922:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784384.762931:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+6:8437:x1874627643075584:12345-0@lo:104: Request processed in 95us (7679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.762939:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787784384.762966:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787784384.762969:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00010000:00010000:2.0:1787784384.762975:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.762986:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2044a00 already unused, calling callback (ffffffffc1c19c20) 00000100:00100000:1.0:1787784384.762990:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634664064:12345-192.168.202.59@tcp:400: 10000000:00010000:2.0:1787784384.763003:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.763016:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.763024:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.763030:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787784384.763152:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075584:0@lo:104: 00000100:00100000:0.0:1787784384.763217:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784384.763356:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643076224:0@lo:103: 00000100:00100000:3.0:1787784384.763433:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784384.763449:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:8437:x1874627643075712:12345-0@lo:104: 00010000:00010000:3.0:1787784384.763459:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.763618:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634664064:12345-192.168.202.59@tcp:400: Request processed in 633us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.763627:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784384.763663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634663808 00000100:00100000:1.0:1787784384.763671:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634663808 00000100:00100000:1.0:1787784384.763728:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1787784384.763736:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634663808:12345-192.168.202.59@tcp:400: 00010000:00010000:2.0:1787784384.764096:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.764108:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.764124:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.764132:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2044a00/0xffb8d925c20ba8d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8d9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.764146:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.764148:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.764150:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.766698:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784384.766719:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:8437:x1874627643075712:12345-0@lo:104: Request processed in 3266us (11453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.766734:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787784384.766773:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784384.766782:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.766819:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784384.766824:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.766835:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.766848:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.766855:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784384.766911:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.766918:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.766928:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.766935:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20ba8a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8af expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.766951:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.766953:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.766955:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784384.766983:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784384.766997:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:8437:x1874627643075840:12345-0@lo:104: 00010000:00010000:2.0:1787784384.767007:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767070:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784384.767075:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:8437:x1874627643075840:12345-0@lo:104: Request processed in 85us (11464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784384.767081:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787784384.767094:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784384.767098:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767105:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784384.767109:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767116:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784384.767123:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784384.767129:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787784384.767147:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767154:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784384.767161:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767167:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2045c00/0xffb8d925c20ba87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba885 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784384.767192:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.767194:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784384.767196:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784384.767584:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075712:0@lo:104: 00000100:00100000:3.0:1787784384.767596:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1874627643075840:0@lo:104: 00010000:00010000:3.0:1787784384.767649:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.767850:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634663808:12345-192.168.202.59@tcp:400: Request processed in 4101us (6806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.767865:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00080000:1.0:1787784384.768084:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784384.768090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784384.768093:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784384.768131:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076096:0@lo:103: 00000100:00100000:1.0:1787784384.768186:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784384.768233:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076608:0@lo:103: 00000100:00100000:1.0:1787784384.768253:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784384.768280:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784384.768286:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076480:0@lo:103: 00000100:00100000:1.0:1787784384.768316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784384.768342:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784384.768355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076096 00000100:00100000:1.0:1787784384.768362:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076096 00010000:00010000:1.0:1787784384.768412:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 18 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.768452:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076608 00000100:00100000:1.0:1787784384.768455:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076608 00010000:00010000:1.0:1787784384.768467:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 19 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.768478:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076480 00000100:00100000:1.0:1787784384.768481:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076480 00010000:00010000:1.0:1787784384.768490:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 20 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.768502:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784384.768510:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3294:x1874627643076096:12345-0@lo:103: 00000100:00100000:2.0:1787784384.769377:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787784384.769396:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787784384.770497:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787784384.770524:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784384.770545:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3294:x1874627643076608:12345-0@lo:103: 00010000:00010000:3.0:1787784384.770574:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784384.770592:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 20 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770613:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 20 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770640:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181513400/0xffb8d925c20ba8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba8a8 expref: 20 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770670:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784384.770670:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784384.770685:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 19 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.770706:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 19 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.770728:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba90a expref: 19 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.770749:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784384.770866:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3294:x1874627643076608:12345-0@lo:103: Request processed in 328us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784384.770876:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784384.770904:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787784384.770912:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784384.770920:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3294:x1874627643076480:12345-0@lo:103: 00010000:00010000:3.0:1787784384.770948:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784384.770954:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 17 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770964:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 17 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770977:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2044800/0xffb8d925c20ba8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba8d2 expref: 17 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.770988:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784384.771258:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3294:x1874627643076096:12345-0@lo:103: Request processed in 2744us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.771271:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784384.771445:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076352:0@lo:103: 00000100:00100000:1.0:1787784384.771488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784384.771667:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784384.771674:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076736:0@lo:103: 00000100:00100000:1.0:1787784384.771699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784384.771720:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787784384.771729:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076352 00000100:00100000:1.0:1787784384.771734:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076352 00010000:00010000:1.0:1787784384.771759:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 16 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.771776:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787784384.771780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076736 00000100:00100000:1.0:1787784384.771783:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076736 00010000:00010000:1.0:1787784384.771793:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 17 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784384.771803:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787784384.771809:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784384.771817:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3296:x1874627643076352:12345-0@lo:103: 00010000:00010000:1.0:1787784384.771827:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784384.771832:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 17 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771841:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 17 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771855:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2044600/0xffb8d925c20ba8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba8e0 expref: 17 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771867:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784384.771897:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3296:x1874627643076352:12345-0@lo:103: Request processed in 81us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.771913:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787784384.771924:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787784384.771930:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784384.771936:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3296:x1874627643076736:12345-0@lo:103: 00010000:00010000:1.0:1787784384.771943:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784384.771947:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 15 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771956:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 15 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771966:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030c00/0xffb8d925c20ba885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba87e expref: 15 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784384.771975:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784384.771998:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3296:x1874627643076736:12345-0@lo:103: Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784384.772004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784384.774953:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784384.775134:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784384.775149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076224 00000100:00100000:0.0:1787784384.775159:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076224 00010000:00010000:0.0:1787784384.775198:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 14 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784384.775224:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787784384.775245:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784384.775255:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3295:x1874627643076224:12345-0@lo:103: 00010000:00010000:0.0:1787784384.775275:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784384.775283:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 14 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775308:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 14 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775332:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2045400/0xffb8d925c20ba8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba8ee expref: 14 pid: 5825 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775354:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775397:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775417:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775441:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775448:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775455:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775461:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784384.775466:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775474:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775495:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784384.775507:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784384.775554:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:3295:x1874627643076224:12345-0@lo:103: Request processed in 301us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784384.775562:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784384.775609:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643076224:0@lo:103: 00000100:00100000:1.0:1787784384.775776:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076736:0@lo:103: 00000100:00100000:1.0:1787784384.775822:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076352:0@lo:103: 00000100:00100000:2.0:1787784384.775872:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076608:0@lo:103: 00000100:00100000:2.0:1787784384.775901:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076096:0@lo:103: 00000100:00100000:3.0:1787784384.776072:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3294:x1874627643076480:12345-0@lo:103: Request processed in 5151us (7753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784384.776082:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787784384.776151:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.776161:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784384.776169:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181512a00/0xffb8d925c20ba988 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784384.777459:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643076480:0@lo:103: 00010000:00010000:2.0:1787784385.141051:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784385.845037:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643076992:0@lo:400: 00000100:00100000:2.0:1787784385.845037:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643077248:0@lo:400: 00000100:00100000:1.0:1787784385.845116:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076864:0@lo:400: 00000100:00100000:2.0:1787784385.846072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784385.846172:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643077120:0@lo:400: 00000100:00100000:2.0:1787784385.846203:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784385.846318:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077248 00000100:00100000:0.0:1787784385.846330:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077248 00000100:00100000:0.0:1787784385.846415:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784385.846428:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643077248:12345-0@lo:400: 00000100:00100000:0.0:1787784385.846563:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643077248:12345-0@lo:400: Request processed in 138us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784385.846590:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787784385.846607:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784385.846686:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077120 00000100:00100000:2.0:1787784385.846691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077120 00010000:00080000:0.0:1787784385.846845:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba342940 x1874627643077248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784385.846862:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643077248:0@lo:400: 00000100:00100000:0.0:1787784385.846898:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076992 00000100:00100000:0.0:1787784385.846902:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076992 00000100:00100000:0.0:1787784385.846931:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787784385.846939:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643076992:12345-0@lo:400: 00000100:00100000:0.0:1787784385.846979:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643076992:12345-0@lo:400: Request processed in 41us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784385.846985:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787784385.847013:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784385.847321:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643076992:0@lo:400: 00000100:00100000:3.0:1787784385.847333:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643077504:0@lo:400: 00000100:00100000:3.0:1787784385.847390:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784385.847531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784385.847567:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643077376:0@lo:400: 00000100:00100000:1.0:1787784385.847598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784385.847603:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077504 00000100:00100000:0.0:1787784385.847610:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077504 00000100:00100000:1.0:1787784385.847638:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643076864 00000100:00100000:1.0:1787784385.847643:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643076864 00000100:00100000:0.0:1787784385.847657:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784385.847668:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643077504:12345-0@lo:400: 00000100:00100000:1.0:1787784385.847691:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787784385.847700:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3296:x1874627643076864:12345-0@lo:400: 00000100:00100000:0.0:1787784385.847714:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643077504:12345-0@lo:400: Request processed in 48us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784385.847722:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787784385.847829:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf40fc00 x1874627643077504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784385.847836:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:3296:x1874627643076864:12345-0@lo:400: Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784385.847854:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787784385.847859:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643077504:0@lo:400: 00000100:00080000:0.0:1787784385.847915:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784385.847943:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643076864:0@lo:400: 00000100:00100000:3.0:1787784385.847949:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077376 00000100:00100000:3.0:1787784385.847955:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077376 00000100:00100000:3.0:1787784385.848085:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784385.848096:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643077376:12345-0@lo:400: 00000100:00100000:3.0:1787784385.848210:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643077376:12345-0@lo:400: Request processed in 117us (612us total) trans 0 rc 0/0 00000100:00080000:0.0:1787784385.848306:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784385.848338:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643077376:0@lo:400: 00000100:00100000:3.0:1787784385.849614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784385.849651:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787784385.849669:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643077120:12345-0@lo:400: 00000100:00100000:3.0:1787784385.849925:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643077120:12345-0@lo:400: Request processed in 264us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784385.849934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787784385.850075:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643077120:0@lo:400: 00010000:00010000:1.0:1787784386.166778:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784386.359205:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643077632:0@lo:13: 00000100:00100000:0.0:1787784386.359333:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.359659:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077632 00000100:00100000:1.0:1787784386.359669:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077632 00000100:00100000:1.0:1787784386.359743:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784386.359755:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643077632:12345-0@lo:13: 00002000:00000024:1.0:1787784386.359803:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784386.359878:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643077632:12345-0@lo:13: Request processed in 126us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784386.359886:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787784386.360086:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fba1c0 x1874627643077632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784386.360110:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643077632:0@lo:13: 10000000:01000000:2.0:1787784386.742512:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787784386.742524:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431bf2b0000 from 39 10000000:01000000:2.0:1787784386.742533:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784386.742625:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.742642:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.742657:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784386.742719:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643077760:0@lo:101: 00000100:00100000:2.0:1787784386.742823:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.742921:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784386.746506:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077760 00000100:00100000:1.0:1787784386.746525:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077760 00000100:00100000:1.0:1787784386.746634:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787784386.746648:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+12:5828:x1874627643077760:12345-0@lo:101: 00010000:00010000:1.0:1787784386.746671:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784386.746699:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba98f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.746736:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba98f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.746749:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba98f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.746786:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0400, rc 0) 00000100:00100000:1.0:1787784386.746907:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643077760:12345-0@lo:101: Request processed in 262us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784386.746915:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787784386.747341:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643077760:0@lo:101: 00010000:00010000:3.0:1787784386.747413:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.747426:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784386.747525:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643077888:0@lo:501: 00000100:00100000:3.0:1787784386.747574:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.747640:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.747762:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643077888 00000100:00100000:0.0:1787784386.747768:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643077888 00000100:00100000:0.0:1787784386.747811:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787784386.747821:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643077888:12345-0@lo:501: 00000100:00100000:0.0:1787784386.748162:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643077888:12345-0@lo:501: Request processed in 341us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.748170:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787784386.748267:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643077888:0@lo:501: 00000100:00100000:3.0:1787784386.748311:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078016:0@lo:503: 00000100:00100000:3.0:1787784386.748361:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.748415:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.749013:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078016 00000100:00100000:0.0:1787784386.749020:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078016 00000100:00100000:0.0:1787784386.749052:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787784386.749060:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643078016:12345-0@lo:503: 00000100:00100000:0.0:1787784386.749262:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643078016:12345-0@lo:503: Request processed in 202us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.749270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787784386.749518:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078016:0@lo:503: 00000100:00100000:1.0:1787784386.751079:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8455:1874627643078144:0@lo:502: 00000100:00100000:1.0:1787784386.751177:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.751229:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189140600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.751508:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078144 00000100:00100000:0.0:1787784386.751517:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078144 00000100:00100000:0.0:1787784386.751569:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787784386.751590:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:8455:x1874627643078144:12345-0@lo:502: 00000100:00100000:0.0:1787784386.751907:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:8455:x1874627643078144:12345-0@lo:502: Request processed in 327us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.751915:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787784386.752090:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8455:1874627643078144:0@lo:502: 00000100:00100000:2.0:1787784386.752159:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8455:1874627643078272:0@lo:502: 00000100:00100000:2.0:1787784386.752203:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.752243:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.752319:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078272 00000100:00100000:3.0:1787784386.752325:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078272 00000100:00100000:3.0:1787784386.752399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787784386.752410:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:8455:x1874627643078272:12345-0@lo:502: 00000100:00100000:3.0:1787784386.752577:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:8455:x1874627643078272:12345-0@lo:502: Request processed in 170us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.752594:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787784386.753173:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8455:1874627643078272:0@lo:502: 00000040:00080000:2.0:1787784386.753210:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787784386.754287:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787784386.754321:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784386.754336:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.754350:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784386.754404:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787784386.754408:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787784386.754412:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784386.754463:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.754473:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.754484:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784386.754532:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078400:0@lo:101: 00000100:00100000:3.0:1787784386.754930:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.754993:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.755069:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078400 00000100:00100000:2.0:1787784386.755078:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078400 00000100:00100000:2.0:1787784386.755144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787784386.755155:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+13:5828:x1874627643078400:12345-0@lo:101: 00010000:00010000:2.0:1787784386.755171:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784386.755189:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0000/0xffb8d925c20ba9a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba99d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.755218:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0000/0xffb8d925c20ba9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba99d expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.755229:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0000/0xffb8d925c20ba9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba99d expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.755239:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0000, rc 0) 00000100:00100000:2.0:1787784386.755303:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643078400:12345-0@lo:101: Request processed in 150us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.755326:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787784386.755505:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078400:0@lo:101: 00010000:00010000:3.0:1787784386.755523:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.755533:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784386.756906:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078528:0@lo:501: 00000100:00100000:3.0:1787784386.756979:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.757020:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.757514:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078528 00000100:00100000:0.0:1787784386.757524:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078528 00000100:00100000:0.0:1787784386.757599:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787784386.757626:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643078528:12345-0@lo:501: 00000100:00100000:0.0:1787784386.757997:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643078528:12345-0@lo:501: Request processed in 372us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.758005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784386.758313:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078528:0@lo:501: 00000100:00100000:3.0:1787784386.759046:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078656:0@lo:503: 00000100:00100000:3.0:1787784386.759127:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.759217:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784386.772742:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078656 00000100:00100000:1.0:1787784386.772767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078656 00000100:00100000:1.0:1787784386.772848:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787784386.772860:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643078656:12345-0@lo:503: 00000100:00100000:1.0:1787784386.773215:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643078656:12345-0@lo:503: Request processed in 356us (14086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784386.773224:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787784386.773557:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643078656:0@lo:503: 00000100:00100000:0.0:1787784386.775665:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8456:1874627643078784:0@lo:502: 00000100:00100000:0.0:1787784386.775783:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.775841:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.775905:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078784 00000100:00100000:2.0:1787784386.775914:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078784 00000100:00100000:2.0:1787784386.775982:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787784386.775993:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:8456:x1874627643078784:12345-0@lo:502: 00000100:00100000:2.0:1787784386.776267:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:8456:x1874627643078784:12345-0@lo:502: Request processed in 275us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.776285:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787784386.776495:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8456:1874627643078784:0@lo:502: 00000020:01000000:0.0:1787784386.776530:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784386.776541:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784386.776544:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787784386.776550:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787784386.776576:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8456:1874627643078912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.776625:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.776662:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893240 going to sleep for 11 seconds 00000100:00100000:1.0:1787784386.776951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643078912 00000100:00100000:1.0:1787784386.776958:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643078912 00000100:00100000:1.0:1787784386.777001:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787784386.777010:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:8456:x1874627643078912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.777191:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:8456:x1874627643078912:12345-0@lo:502:llog_process_th.0 Request processed in 182us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784386.777199:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787784386.777407:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8456:1874627643078912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784386.777432:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784386.777439:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784386.777441:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787784386.777445:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787784386.777678:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787784386.777700:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787784386.777713:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.777725:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784386.777737:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787784386.777740:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431b9ffe000 from 39 10000000:01000000:2.0:1787784386.777743:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784386.777778:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.777788:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.777798:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784386.777816:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.777864:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.777891:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.778264:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079040 00000100:00100000:3.0:1787784386.778271:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079040 00000100:00100000:3.0:1787784386.778329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787784386.778340:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:5828:x1874627643079040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784386.778353:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784386.778412:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943181513400/0xffb8d925c20ba9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba9ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.778449:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943181513400/0xffb8d925c20ba9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba9ab expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.778462:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943181513400/0xffb8d925c20ba9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba9ab expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.778472:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513400, rc 0) 00000100:00100000:3.0:1787784386.778520:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.778527:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787784386.778657:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784386.778673:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.778683:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784386.778748:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.778779:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.778798:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.778891:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079168 00000100:00100000:3.0:1787784386.778895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079168 00000100:00100000:3.0:1787784386.778926:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787784386.778932:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.779232:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.779240:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787784386.779575:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.780559:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.781430:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.781483:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.781754:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079296 00000100:00100000:0.0:1787784386.781765:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079296 00000100:00100000:0.0:1787784386.781831:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787784386.781843:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784386.782099:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.782107:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787784386.782576:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784386.786076:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8457:1874627643079424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.786205:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.786318:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.791421:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079424 00000100:00100000:2.0:1787784386.791443:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079424 00000100:00100000:2.0:1787784386.791531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787784386.791543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:8457:x1874627643079424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784386.791959:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:8457:x1874627643079424:12345-0@lo:502:llog_process_th.0 Request processed in 417us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.791967:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787784386.792815:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8457:1874627643079424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.792914:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8457:1874627643079552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.792981:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.793044:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.793210:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079552 00000100:00100000:3.0:1787784386.793216:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079552 00000100:00100000:3.0:1787784386.793289:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787784386.793300:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:8457:x1874627643079552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784386.793925:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:8457:x1874627643079552:12345-0@lo:502:llog_process_th.0 Request processed in 624us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.793935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787784386.794062:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8457:1874627643079552:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787784386.794092:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787784386.794491:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787784386.794522:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787784386.794535:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.794549:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784386.794561:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787784386.794564:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787784386.794568:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784386.794819:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.794830:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.794841:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784386.794869:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.794922:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.795010:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.795197:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079680 00000100:00100000:0.0:1787784386.795205:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079680 00000100:00100000:0.0:1787784386.795465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787784386.795478:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:5828:x1874627643079680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784386.795493:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784386.795510:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180031400/0xffb8d925c20ba9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba9b9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.795540:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180031400/0xffb8d925c20ba9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba9b9 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.795552:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180031400/0xffb8d925c20ba9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba9b9 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.795560:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180031400, rc 0) 00000100:00100000:0.0:1787784386.795780:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643079680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.795788:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787784386.795879:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784386.795897:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.795925:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784386.795993:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.796024:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.802060:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.806308:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079808 00000100:00100000:2.0:1787784386.806330:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079808 00000100:00100000:2.0:1787784386.806429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787784386.806440:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643079808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.810949:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643079808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4497us (14911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.810984:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787784386.811123:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.811194:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.811257:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.811314:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.811417:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643079936 00000100:00100000:0.0:1787784386.811426:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643079936 00000100:00100000:0.0:1787784386.811474:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787784386.811486:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643079936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784386.811707:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643079936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.811715:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787784386.811958:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643079936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.812889:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8458:1874627643080064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784386.812955:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.813001:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.813056:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080064 00000100:00100000:0.0:1787784386.813063:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080064 00000100:00100000:0.0:1787784386.813108:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787784386.813119:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:8458:x1874627643080064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.813446:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:8458:x1874627643080064:12345-0@lo:502:llog_process_th.0 Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.813454:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787784386.820689:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8458:1874627643080064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784386.820765:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784386.820784:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784386.820787:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787784386.820794:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787784386.820855:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8458:1874627643080192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784386.820961:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.821163:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.828445:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080192 00000100:00100000:0.0:1787784386.828470:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080192 00000100:00100000:0.0:1787784386.828552:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784386.828564:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:8458:x1874627643080192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.828935:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:8458:x1874627643080192:12345-0@lo:502:llog_process_th.0 Request processed in 372us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.828945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787784386.829121:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8458:1874627643080192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784386.829163:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784386.829172:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784386.829176:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787784386.829180:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787784386.829536:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787784386.829559:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787784386.829572:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.829585:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784386.829599:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787784386.829602:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff94318875c800 from 39 10000000:01000000:0.0:1787784386.829606:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787784386.829648:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.829656:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.829675:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784386.829700:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784386.829747:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.829792:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.829840:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080320 00000100:00100000:3.0:1787784386.829846:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080320 00000100:00100000:3.0:1787784386.829885:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787784386.829893:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643080320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784386.829906:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784386.829938:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611800/0xffb8d925c20ba9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba9c7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.829966:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611800/0xffb8d925c20ba9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba9c7 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.829976:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611800/0xffb8d925c20ba9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba9c7 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.829985:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611800, rc 0) 00000100:00100000:3.0:1787784386.830022:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.830028:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787784386.830103:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784386.830117:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.830126:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784386.830182:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.830211:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.830235:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.830292:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080448 00000100:00100000:3.0:1787784386.830296:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080448 00000100:00100000:3.0:1787784386.830330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787784386.830337:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.830651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.830659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787784386.830739:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.830772:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.830813:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.830841:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.831042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080576 00000100:00100000:3.0:1787784386.831046:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080576 00000100:00100000:3.0:1787784386.831074:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787784386.831081:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.831238:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.831245:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787784386.831359:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.831869:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8459:1874627643080704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784386.831915:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784386.831948:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.831997:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080704 00000100:00100000:2.0:1787784386.832001:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080704 00000100:00100000:2.0:1787784386.832039:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787784386.832047:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8459:x1874627643080704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784386.832248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8459:x1874627643080704:12345-0@lo:502:llog_process_th.0 Request processed in 202us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.832256:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787784386.832351:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8459:1874627643080704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.832436:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8459:1874627643080832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784386.832470:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.832496:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784386.832556:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080832 00000100:00100000:1.0:1787784386.832560:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080832 00000100:00100000:1.0:1787784386.832585:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787784386.832592:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8459:x1874627643080832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.832742:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8459:x1874627643080832:12345-0@lo:502:llog_process_th.0 Request processed in 149us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784386.832749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787784386.832850:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8459:1874627643080832:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787784386.832870:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787784386.833443:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787784386.833474:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784386.833487:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.833499:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784386.833510:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787784386.833514:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787784386.833517:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787784386.833550:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.833559:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.833582:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784386.833601:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784386.833641:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.833662:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.833734:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643080960 00000100:00100000:0.0:1787784386.833739:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643080960 00000100:00100000:0.0:1787784386.833772:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787784386.833779:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643080960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784386.833792:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784386.833811:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180031a00/0xffb8d925c20ba9dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba9d5 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.833840:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180031a00/0xffb8d925c20ba9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba9d5 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.833851:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180031a00/0xffb8d925c20ba9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba9d5 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.833873:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180031a00, rc 0) 00000100:00100000:0.0:1787784386.833916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643080960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784386.833923:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787784386.834042:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643080960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784386.834057:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784386.834066:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784386.834118:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784386.834145:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.834175:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.834218:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081088 00000100:00100000:3.0:1787784386.834223:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081088 00000100:00100000:3.0:1787784386.834264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787784386.834272:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643081088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.834636:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643081088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.834644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787784386.834773:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784386.834805:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784386.834848:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.834870:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.834912:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081216 00000100:00100000:2.0:1787784386.834917:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081216 00000100:00100000:2.0:1787784386.834953:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787784386.834961:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643081216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.835126:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643081216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.835132:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787784386.835328:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784386.836050:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8460:1874627643081344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.836102:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.836138:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784386.836198:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081344 00000100:00100000:2.0:1787784386.836204:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081344 00000100:00100000:2.0:1787784386.836250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787784386.836260:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8460:x1874627643081344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784386.836670:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8460:x1874627643081344:12345-0@lo:502:llog_process_th.0 Request processed in 411us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.836677:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787784386.836848:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8460:1874627643081344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784386.836881:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784386.836893:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784386.836896:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784386.836907:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787784386.836935:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8460:1874627643081472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784386.836973:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784386.837043:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431841f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784386.842231:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081472 00000100:00100000:0.0:1787784386.842261:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081472 00000100:00100000:2.0:1787784386.846933:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787784386.846953:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8460:x1874627643081472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784386.847612:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8460:x1874627643081472:12345-0@lo:502:llog_process_th.0 Request processed in 663us (10636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784386.847622:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787784386.847744:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8460:1874627643081472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784386.847785:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784386.847794:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784386.847796:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787784386.847801:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787784386.848011:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787784386.848337:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787784386.848351:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.848433:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784386.848461:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787784386.848465:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431857819b8 from 1 10000000:01000000:2.0:1787784386.848468:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787784386.848510:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.848519:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784386.848530:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784386.848557:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784386.848610:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784386.848655:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.848740:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081600 00000100:00100000:3.0:1787784386.848749:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081600 00000100:00100000:3.0:1787784386.848792:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787784386.848801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643081600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784386.848815:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784386.848831:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611600/0xffb8d925c20ba9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20ba9e3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.848870:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611600/0xffb8d925c20ba9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20ba9e3 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.848882:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611600/0xffb8d925c20ba9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba9e3 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784386.848891:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611600, rc 0) 00000100:00100000:3.0:1787784386.848946:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643081600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784386.848954:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787784386.849033:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784386.849050:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.849060:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784386.849123:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784386.849154:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784386.849183:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784386.849402:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081728 00000100:00100000:3.0:1787784386.849406:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081728 00000100:00100000:3.0:1787784386.849433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787784386.849440:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643081728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784386.849719:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643081728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (564us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784386.849728:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787784386.849828:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643081728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787784386.849858:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787784386.849867:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784386.849876:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784387.188777:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784388.216439:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784389.238184:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784389.429502:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784389.429635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784389.429892:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081856 00000100:00100000:3.0:1787784389.429905:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081856 00000100:00100000:3.0:1787784389.429983:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784389.429996:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643081856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784389.430045:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787784389.430462:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784389.431844:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643081856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1841us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784389.431859:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787784389.431890:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943186e0ed00 x1874627643081856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784389.431925:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784389.880941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.881057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664192 00000100:00100000:2.0:1787784389.881079:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664192 00000100:00100000:2.0:1787784389.881156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:2.0:1787784389.881169:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:5609:x1874627634664192:12345-192.168.202.59@tcp:101: 00010000:00010000:2.0:1787784389.881193:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784389.881219:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8a9 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.882019:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a9 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.882095:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a9 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.882108:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0400, rc 0) 00000100:00100000:2.0:1787784389.882182:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634664192:12345-192.168.202.59@tcp:101: Request processed in 1015us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.882191:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:3.0:1787784389.892783:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784389.892843:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784389.892867:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784389.892899:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.892965:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664576 00000100:00100000:2.0:1787784389.892977:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664576 00000100:00100000:1.0:1787784389.892991:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664448 00000100:00100000:0.0:1787784389.892999:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664320 00000100:00100000:1.0:1787784389.893006:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664448 00000100:00100000:0.0:1787784389.893008:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664320 00000100:00100000:2.0:1787784389.893070:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784389.893077:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1787784389.893085:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634664576:12345-192.168.202.59@tcp:400: 00000100:00100000:0.0:1787784389.893091:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634664320:12345-192.168.202.59@tcp:400: 00000100:00100000:1.0:1787784389.893147:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784389.893161:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634664448:12345-192.168.202.59@tcp:400: 00000100:00100000:2.0:1787784389.893175:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634664576:12345-192.168.202.59@tcp:400: Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.893188:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784389.893223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664704 00000100:00100000:2.0:1787784389.893227:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664704 00000100:00080000:3.0:1787784389.893259:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784389.893264:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00080000:3.0:1787784389.893267:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784389.893271:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784389.893276:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634664704:12345-192.168.202.59@tcp:501: 00000100:00100000:0.0:1787784389.898111:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634664320:12345-192.168.202.59@tcp:400: Request processed in 5013us (5324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784389.898128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:1.0:1787784389.898398:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634664448:12345-192.168.202.59@tcp:400: Request processed in 5228us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784389.898414:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784389.900316:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634664704:12345-192.168.202.59@tcp:501: Request processed in 7032us (7403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.900331:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:3.0:1787784389.906992:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.907121:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664832 00000100:00100000:2.0:1787784389.907130:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664832 00000100:00100000:2.0:1787784389.907187:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:2.0:1787784389.907196:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634664832:12345-192.168.202.59@tcp:503: 00000100:00100000:2.0:1787784389.907489:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634664832:12345-192.168.202.59@tcp:503: Request processed in 292us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.907497:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:0.0:1787784389.911097:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.911689:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634664960 00000100:00100000:2.0:1787784389.911705:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634664960 00000100:00100000:2.0:1787784389.911770:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:2.0:1787784389.911780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:6102:x1874627634664960:12345-192.168.202.59@tcp:502: 00000100:00100000:2.0:1787784389.912823:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:6102:x1874627634664960:12345-192.168.202.59@tcp:502: Request processed in 1038us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.912837:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:3.0:1787784389.916648:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.916776:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665088 00000100:00100000:2.0:1787784389.916792:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665088 00000100:00100000:2.0:1787784389.916874:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:2.0:1787784389.916887:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:6102:x1874627634665088:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784389.917812:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:6102:x1874627634665088:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 922us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.917824:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:3.0:1787784389.924494:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.924840:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665216 00000100:00100000:2.0:1787784389.924855:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665216 00000100:00100000:2.0:1787784389.924922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:2.0:1787784389.924932:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634665216:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784389.924949:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784389.924967:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1400/0xffb8d925c20ba9f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8b0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.925010:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1400/0xffb8d925c20ba9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b0 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.925037:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1400/0xffb8d925c20ba9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b0 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784389.925048:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1400, rc 0) 00000100:00100000:2.0:1787784389.925110:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665216:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 181us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784389.925117:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:0.0:1787784389.927623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784389.927998:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665344 00000100:00100000:2.0:1787784389.928011:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665344 00000100:00100000:2.0:1787784389.928084:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 172 00000100:00100000:2.0:1787784389.928096:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665344:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784389.928513:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665344:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 418us (912us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784389.928523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 172 00010000:00010000:1.0:1787784390.262959:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784390.965798:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643082368:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.965900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.965978:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784390.965985:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643081984:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.966046:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643082496:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.966117:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643082112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966145:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.966165:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643082624:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966189:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.966210:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784390.966215:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643082240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784390.966286:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082368 00000100:00100000:0.0:1787784390.966315:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082368 00000100:00100000:0.0:1787784390.966404:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082624 00000100:00100000:0.0:1787784390.966408:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082624 00000100:00100000:0.0:1787784390.966449:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784390.966460:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643082368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966524:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643082368:12345-0@lo:400:kworker.0 Request processed in 66us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966532:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784390.966550:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784390.966557:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643082624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966589:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643082624:12345-0@lo:400:kworker.0 Request processed in 32us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966595:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784390.966614:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643081984 00000100:00100000:0.0:1787784390.966618:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643081984 00000100:00100000:0.0:1787784390.966643:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787784390.966650:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643081984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966680:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643081984:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966686:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787784390.966717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082496 00000100:00100000:0.0:1787784390.966722:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082496 00000100:00100000:0.0:1787784390.966743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082112 00000100:00100000:0.0:1787784390.966746:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082112 00000100:00100000:0.0:1787784390.966756:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082240 00000100:00100000:0.0:1787784390.966759:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082240 00000100:00100000:0.0:1787784390.966776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784390.966782:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643082496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966824:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643082496:12345-0@lo:400:kworker.0 Request processed in 42us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784390.966843:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784390.966850:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643082112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643082112:12345-0@lo:400:kworker.0 Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966883:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787784390.966894:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784390.966899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643082240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.966925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643082240:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784390.966930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787784390.966962:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784390.966967:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784390.967028:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643082240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.967043:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643082112:0@lo:400:kworker.0 00010000:00080000:0.0:1787784390.967058:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac4f00 x1874627643082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784390.967069:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643082624:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.967215:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643081984:0@lo:400:kworker.0 00000100:00100000:0.0:1787784390.967229:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643082496:0@lo:400:kworker.0 00010000:00080000:0.0:1787784390.967256:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba342580 x1874627643082368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784390.967275:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643082368:0@lo:400:kworker.0 00010000:00010000:2.0:1787784391.287312:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784391.484575:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784391.484669:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784391.484977:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643082752 00000100:00100000:1.0:1787784391.484987:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643082752 00000100:00100000:1.0:1787784391.485044:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787784391.485054:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643082752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784391.485089:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784391.485158:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643082752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784391.485166:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787784391.485256:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbb0c0 x1874627643082752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784391.485276:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643082752:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787784391.846977:0:8500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc38e445c0 20000000:00000080:1.0:1787784391.847001:0:8500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431bf6fec00 uarg=0000000000000000 20000000:01000000:1.0:1787784391.847035:0:8500:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787784391.847040:0:8500:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787784391.847045:0:8500:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787784391.854218:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787784391.854658:0:8500:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787784391.866156:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787784391.866988:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787784391.867917:0:8500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787784391.867948:0:8500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787784391.867972:0:8500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.867991:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.867998:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868005:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868014:0:8500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868022:0:8500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868578:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868808:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 9 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784391.868824:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643082880:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784391.868952:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.868958:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 18 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784391.868966:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083008:0@lo:104: 00000100:00100000:1.0:1787784391.869000:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784391.869042:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.869054:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784391.869059:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083136:0@lo:104: 00000100:00100000:1.0:1787784391.869084:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787784391.869102:0:8500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.869107:0:8500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 18 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784391.869122:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083264:0@lo:104: 00000100:00100000:1.0:1787784391.869138:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787784391.869793:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787784391.869824:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784391.869869:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083008 00000100:00100000:1.0:1787784391.869877:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083008 00000100:00100000:1.0:1787784391.869923:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083136 00000100:00100000:1.0:1787784391.869926:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083136 00000100:00100000:1.0:1787784391.869936:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083264 00000100:00100000:1.0:1787784391.869939:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083264 00000100:00100000:1.0:1787784391.869954:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784391.869962:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:8500:x1874627643083008:12345-0@lo:104: 00010000:00010000:1.0:1787784391.869979:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870042:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787784391.870049:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:8500:x1874627643083008:12345-0@lo:104: Request processed in 87us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784391.870058:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784391.870079:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784391.870087:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:8500:x1874627643083136:12345-0@lo:104: 00010000:00010000:1.0:1787784391.870095:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870128:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787784391.870134:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:8500:x1874627643083136:12345-0@lo:104: Request processed in 49us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784391.870149:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784391.870189:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784391.870196:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:8500:x1874627643083264:12345-0@lo:104: 00010000:00010000:1.0:1787784391.870204:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870246:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787784391.870251:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:8500:x1874627643083264:12345-0@lo:104: Request processed in 56us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784391.870257:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787784391.870273:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784391.870278:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870285:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784391.870290:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870298:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784391.870305:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784391.870310:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784391.870342:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870349:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784391.870393:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870400:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d1400/0xffb8d925c20ba89a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba8a1 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870413:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784391.870416:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870422:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784391.870425:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870431:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784391.870437:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784391.870441:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784391.870455:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870460:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784391.870466:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870472:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2045000/0xffb8d925c20ba7cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba7d6 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870480:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784391.870489:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870494:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512600 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784391.870497:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870503:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784391.870509:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784391.870514:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784391.870528:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870533:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784391.870551:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870558:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181512600/0xffb8d925c20ba76d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20ba774 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.870573:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784391.870574:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784391.870576:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784391.870609:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083008:0@lo:104: 00000100:00100000:1.0:1787784391.870618:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083136:0@lo:104: 00000100:00100000:1.0:1787784391.870625:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643083264:0@lo:104: 00010000:00010000:2.0:1787784391.870815:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784391.870832:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643083520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784391.870873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784391.870908:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784391.870922:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643083392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784391.870949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784391.870972:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784391.870981:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643083648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784391.871004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784391.871029:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083520 00000100:00100000:2.0:1787784391.871032:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083520 00010000:00010000:2.0:1787784391.871054:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 19 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784391.871071:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083392 00000100:00100000:2.0:1787784391.871074:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083392 00010000:00010000:2.0:1787784391.871083:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 20 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784391.871093:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083648 00000100:00100000:2.0:1787784391.871096:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083648 00010000:00010000:2.0:1787784391.871105:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 21 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784391.871116:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784391.871123:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3296:x1874627643083520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784391.871133:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784391.871138:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 21 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871148:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 21 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871161:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0800/0xffb8d925c20ba7d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba7cf expref: 21 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871181:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784391.871210:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3296:x1874627643083520:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784391.871216:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784391.871246:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784391.871253:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643083392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784391.871260:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784391.871264:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 19 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871272:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 19 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871281:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2045a00/0xffb8d925c20ba8a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba89a expref: 19 pid: 5823 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871289:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784391.871308:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3296:x1874627643083392:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784391.871314:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784391.871325:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784391.871330:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3294:x1874627643083648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784391.871337:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784391.871341:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871349:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871393:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030200/0xffb8d925c20ba774 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20ba76d expref: 17 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.871404:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784391.871434:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3294:x1874627643083648:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784391.871441:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784391.871475:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643083648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784391.871498:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643083392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784391.871504:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643083520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784391.882816:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784391.882931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665472 00000100:00100000:2.0:1787784391.882949:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665472 00010000:00010000:2.0:1787784391.883009:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 10 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784391.883062:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1787784391.883085:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2363:x1874627634665472:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784391.883108:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784391.883115:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 10 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883130:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 10 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883156:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883183:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883202:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883210:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883216:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883224:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883239:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784391.883243:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883251:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883261:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784391.883276:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784391.883357:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2363:x1874627634665472:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 286us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784391.883392:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:1.0:1787784391.883638:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1800/0xffb8d925c20ba95e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a878 expref: 9 pid: 5825 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784391.883654:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbb0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8500:1874627643082880:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784391.883687:0:8500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.883697:0:8500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.883703:0:8500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784391.883719:0:8500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1c00/0xffb8d925c20ba9ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784392.308544:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784393.143815:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784393.143915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665600 00000100:00100000:0.0:1787784393.143929:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665600 00000100:00100000:0.0:1787784393.144002:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:0.0:1787784393.144014:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:5609:x1874627634665600:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784393.144036:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784393.144061:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8b7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.144098:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.144112:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.144124:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030c00, rc 0) 00000100:00100000:0.0:1787784393.144207:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665600:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 194us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784393.144215:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:3.0:1787784393.158822:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784393.160601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665728 00000100:00100000:2.0:1787784393.160631:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665728 00000100:00100000:2.0:1787784393.160716:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:2.0:1787784393.160728:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665728:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784393.161153:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665728:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 425us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784393.161163:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:3.0:1787784393.168783:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784393.168941:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665856 00000100:00100000:0.0:1787784393.168954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665856 00000100:00100000:0.0:1787784393.169015:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:0.0:1787784393.169025:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665856:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784393.169312:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:5609:x1874627634665856:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 287us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784393.169330:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:3.0:1787784393.193205:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784393.202813:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634665984 00000100:00100000:0.0:1787784393.202835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634665984 00000100:00100000:0.0:1787784393.208231:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:0.0:1787784393.208252:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:6159:x1874627634665984:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784393.219055:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:6159:x1874627634665984:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 10792us (25848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784393.219073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:0.0:1787784393.252246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784393.255485:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666112 00000100:00100000:1.0:1787784393.255508:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666112 00000100:00100000:1.0:1787784393.255595:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 178 00000100:00100000:1.0:1787784393.255609:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:6159:x1874627634666112:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784393.256593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:6159:x1874627634666112:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 978us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784393.256606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 178 00010000:00010000:2.0:1787784393.338354:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787784393.400656:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784393.400667:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431bf2b0000 from 4 10000000:01000000:1.0:1787784393.400675:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784393.400752:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784393.400803:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784393.400818:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784393.400853:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643083776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784393.400949:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784393.401242:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784393.403151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083776 00000100:00100000:0.0:1787784393.403171:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083776 00000100:00100000:0.0:1787784393.403272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787784393.403284:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643083776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784393.403304:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784393.403327:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa0d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.403391:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.403405:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784393.403416:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180031800, rc 0) 00000100:00100000:0.0:1787784393.403519:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643083776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784393.403527:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787784393.404146:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643083776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784393.404173:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.404185:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784393.407662:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643083904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.407745:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.407802:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784393.408014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643083904 00000100:00100000:2.0:1787784393.408029:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643083904 00000100:00100000:2.0:1787784393.410163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787784393.410206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643083904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784393.411687:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643083904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1507us (3938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784393.411699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787784393.411853:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643083904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.411913:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.411963:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.412053:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784393.412088:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084032 00000100:00100000:2.0:1787784393.412095:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084032 00000100:00100000:2.0:1787784393.412424:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787784393.412494:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643084032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784393.412691:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643084032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784393.412699:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787784393.412787:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784393.413241:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8536:1874627643084160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784393.413279:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784393.413342:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b45919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.413515:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084160 00000100:00100000:3.0:1787784393.413521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084160 00000100:00100000:3.0:1787784393.413626:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787784393.413634:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8536:x1874627643084160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.413807:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8536:x1874627643084160:12345-0@lo:502:llog_process_th.0 Request processed in 173us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.413814:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787784393.413885:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8536:1874627643084160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784393.413912:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784393.413921:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784393.413923:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787784393.413932:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431bf2b0000 00000020:00000080:1.0:1787784393.413934:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784393.414015:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8536:1874627643084288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784393.414053:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784393.414226:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084288 00000100:00100000:2.0:1787784393.414231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084288 00000100:00100000:1.0:1787784393.414534:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787784393.414543:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8536:x1874627643084288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784393.414692:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:8536:x1874627643084288:12345-0@lo:502:llog_process_th.0 Request processed in 151us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784393.414700:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787784393.420443:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784393.420832:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196292d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8536:1874627643084288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784393.420882:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784393.420891:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784393.420893:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787784393.420898:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787784393.421139:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787784393.421173:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784393.421185:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.421196:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784393.421208:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784393.421210:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9ffe000 from 4 10000000:01000000:3.0:1787784393.421213:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784393.421261:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.421270:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.421280:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784393.421305:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.421901:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.421956:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784393.422023:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084416 00000100:00100000:2.0:1787784393.422031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084416 00000100:00100000:2.0:1787784393.422139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787784393.422159:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643084416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784393.422176:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784393.422193:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa1b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784393.422230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784393.422241:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784393.422251:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1a00, rc 0) 00000100:00100000:2.0:1787784393.422294:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643084416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784393.422300:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787784393.422358:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784393.422388:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.422398:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784393.422614:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.422646:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.422671:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.422685:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084544 00000100:00100000:3.0:1787784393.422689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084544 00000100:00100000:3.0:1787784393.422716:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787784393.422723:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643084544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.423005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643084544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.423012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787784393.423046:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.423076:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.423112:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.423125:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.423135:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084672 00000100:00100000:3.0:1787784393.423139:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084672 00000100:00100000:3.0:1787784393.423174:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784393.423188:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643084672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.423340:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643084672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.423346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784393.423402:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643084672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.423592:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8537:1874627643084800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.423623:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.423640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084800 00000100:00100000:3.0:1787784393.423643:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084800 00000100:00100000:3.0:1787784393.423661:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787784393.423667:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8537:x1874627643084800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.423780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8537:x1874627643084800:12345-0@lo:502:llog_process_th.0 Request processed in 112us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.423786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787784393.423813:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2bdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.423825:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8537:1874627643084800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784393.423843:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784393.423853:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784393.423855:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784393.423862:0:8537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b9ffe000 00000020:00000080:3.0:1787784393.423865:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784393.423926:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8537:1874627643084928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.423955:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.423973:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643084928 00000100:00100000:3.0:1787784393.423976:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643084928 00000100:00100000:3.0:1787784393.423999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787784393.424005:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8537:x1874627643084928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.424098:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:8537:x1874627643084928:12345-0@lo:502:llog_process_th.0 Request processed in 92us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.424104:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787784393.424129:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.424138:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8537:1874627643084928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784393.424153:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784393.424157:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784393.424158:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787784393.424162:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787784393.424208:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787784393.424236:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784393.424246:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424256:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784393.424267:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784393.424270:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94318875c800 from 4 10000000:01000000:3.0:1787784393.424273:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784393.424295:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424302:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424311:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784393.424329:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.424353:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.424387:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.424399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085056 00000100:00100000:3.0:1787784393.424402:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085056 00000100:00100000:3.0:1787784393.424422:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787784393.424428:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643085056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784393.424437:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784393.424449:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa29 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424470:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424479:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424489:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610a00, rc 0) 00000100:00100000:3.0:1787784393.424516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643085056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.424522:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787784393.424550:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784393.424560:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.424569:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784393.424615:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.424639:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.424652:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.424663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085184 00000100:00100000:3.0:1787784393.424665:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085184 00000100:00100000:3.0:1787784393.424684:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787784393.424689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643085184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.424880:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643085184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.424887:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787784393.424915:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.424939:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.424970:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784393.424982:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.424992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085312 00000100:00100000:3.0:1787784393.424995:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085312 00000100:00100000:3.0:1787784393.425013:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787784393.425019:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643085312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784393.425121:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643085312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.425128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787784393.425159:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643085312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784393.426081:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8538:1874627643085440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784393.426124:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784393.426235:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784393.426273:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085440 00000100:00100000:3.0:1787784393.426284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085440 00000100:00100000:3.0:1787784393.426517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787784393.426526:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:8538:x1874627643085440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784393.426682:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:8538:x1874627643085440:12345-0@lo:502:llog_process_th.0 Request processed in 158us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784393.426689:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787784393.427989:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8538:1874627643085440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784393.428042:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784393.428052:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784393.428054:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787784393.428061:0:8538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff94318875c800 00000020:00000080:2.0:1787784393.428064:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787784393.428156:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8538:1874627643085568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784393.428224:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784393.428267:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085568 00000100:00100000:2.0:1787784393.428272:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085568 00000100:00100000:2.0:1787784393.428313:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787784393.428322:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:8538:x1874627643085568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784393.428559:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:8538:x1874627643085568:12345-0@lo:502:llog_process_th.0 Request processed in 237us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784393.428567:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787784393.428608:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591780 going to sleep for 11 seconds 00000100:00100000:2.0:1787784393.428620:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:8538:1874627643085568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787784393.428638:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784393.428642:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784393.428644:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787784393.428648:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787784393.429040:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787784393.429060:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784393.429071:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784393.429084:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784394.367052:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784394.559822:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643085696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784394.559951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784394.573462:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085696 00000100:00100000:0.0:1787784394.573484:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085696 00000100:00100000:0.0:1787784394.573589:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784394.573601:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643085696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784394.573668:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787784394.574302:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784394.588588:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643085696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14976us (28624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784394.588607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787784394.588831:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943189162d00 x1874627643085696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784394.588865:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643085696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784395.011161:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784395.011236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784395.011265:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784395.011296:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784395.011330:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666496 00000100:00100000:3.0:1787784395.011340:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666496 00000100:00100000:3.0:1787784395.011446:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666624 00000100:00100000:3.0:1787784395.011450:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666624 00000100:00100000:3.0:1787784395.011558:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1787784395.011571:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634666496:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784395.011658:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634666496:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 90us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784395.011667:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1787784395.011751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666368 00000100:00100000:1.0:1787784395.011756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666368 00000100:00100000:2.0:1787784395.011795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666240 00000100:00100000:1.0:1787784395.011798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784395.011809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634666368:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784395.011812:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666240 00000100:00100000:1.0:1787784395.011847:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634666368:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784395.011854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:2.0:1787784395.011895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:2.0:1787784395.011914:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634666240:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784395.011918:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1787784395.011943:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634666624:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:1.0:1787784395.011966:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784395.011971:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784395.011972:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784395.012011:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634666240:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 104us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784395.012036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:3.0:1787784395.012073:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634666624:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 132us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784395.012084:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00010000:00010000:2.0:1787784395.380698:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784396.086039:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643085952:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.086123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.086202:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643086464:0@lo:400:kworker.0 00000100:00100000:3.0:1787784396.086207:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643086080:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.086229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.086264:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787784396.086270:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643085824:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.086300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.086322:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643086336:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.086342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784396.086361:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.086386:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643086208:0@lo:400:kworker.0 00000100:00100000:3.0:1787784396.086433:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085824 00000100:00100000:2.0:1787784396.086476:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643085952 00000100:00100000:2.0:1787784396.086481:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085952 00000100:00100000:3.0:1787784396.086512:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643085824 00000100:00100000:2.0:1787784396.086520:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086336 00000100:00100000:2.0:1787784396.086522:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086336 00000100:00100000:2.0:1787784396.086542:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086080 00000100:00100000:3.0:1787784396.086543:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787784396.086545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086080 00000100:00100000:3.0:1787784396.086551:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643085824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784396.086559:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784396.086565:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643085952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784396.086624:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787784396.086633:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787784396.086733:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787784396.086754:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643086336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.088284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.088383:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086464 00000100:00100000:1.0:1787784396.088406:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086464 00000100:00100000:1.0:1787784396.088456:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086208 00000100:00100000:1.0:1787784396.088460:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086208 00000100:00100000:1.0:1787784396.088482:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784396.088491:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.088556:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643086464:12345-0@lo:400:kworker.0 Request processed in 67us (2326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784396.088563:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787784396.088579:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787784396.088585:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.088613:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643086208:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784396.088619:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787784396.088665:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac52c0 x1874627643086208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784396.088681:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643086208:0@lo:400:kworker.0 00010000:00080000:1.0:1787784396.088717:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac4780 x1874627643086464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784396.088727:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643086464:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.090563:0:8617:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787784396.090577:0:8617:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787784396.090712:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784396.090728:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643086080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.092228:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643086080:12345-0@lo:400:kworker.0 Request processed in 1291us (5651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784396.092243:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787784396.092502:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643086080:0@lo:400:kworker.0 00000100:00080000:1.0:1787784396.092555:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784396.092562:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784396.092565:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784396.093758:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643085824:12345-0@lo:400:kworker.0 Request processed in 7200us (7448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784396.093774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787784396.093965:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643085952:12345-0@lo:400:kworker.0 Request processed in 7398us (7840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784396.093975:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784396.094288:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643085824:0@lo:400:kworker.0 00000100:00100000:1.0:1787784396.094306:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643085952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784396.097129:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643086336:12345-0@lo:400:kworker.0 Request processed in 10377us (10773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784396.097144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787784396.102484:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643086336:0@lo:400:kworker.0 00010000:00010000:1.0:1787784396.406571:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784396.604884:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784396.604911:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643086592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784396.604999:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784396.605179:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086592 00000100:00100000:1.0:1787784396.605195:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086592 00000100:00100000:1.0:1787784396.605254:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787784396.605263:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643086592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784396.605303:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784396.605412:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643086592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784396.605419:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787784396.605557:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962912c0 x1874627643086592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784396.605577:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643086592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787784397.432600:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784398.457533:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784399.489800:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784399.674523:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784399.674560:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643086720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784399.674821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784399.674855:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086720 00000100:00100000:1.0:1787784399.674863:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086720 00000100:00100000:1.0:1787784399.674927:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787784399.674938:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643086720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784399.674980:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784399.675034:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643086720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00080000:2.0:1787784399.676119:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784399.676375:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787784399.679019:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943186e0fc00 x1874627643086720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784399.679049:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643086720:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787784400.032930:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787784400.136048:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784400.136118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784400.136282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666880 00000100:00100000:0.0:1787784400.136296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666880 00000100:00080000:3.0:1787784400.136400:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784400.136438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1787784400.136452:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634666880:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784400.136849:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634666880:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 399us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784400.136859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1787784400.137444:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634666752 00000100:00100000:2.0:1787784400.137452:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634666752 00000100:00100000:2.0:1787784400.137538:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:2.0:1787784400.137547:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634666752:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784400.137593:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634666752:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 47us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784400.137600:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:3.0:1787784400.141816:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784400.141957:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784400.141996:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667008 00000100:00100000:3.0:1787784400.142008:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667008 00000100:00100000:3.0:1787784400.142066:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667136 00000100:00100000:3.0:1787784400.142069:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667136 00000100:00100000:3.0:1787784400.142093:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784400.142102:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2361:x1874627634667008:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1787784400.142169:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba96c 00000100:00080000:3.0:1787784400.142182:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431862b8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784400.142232:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787784400.144030:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+2:2361:x1874627634667008:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 1917us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784400.144046:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784400.144079:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1787784400.144090:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2361:x1874627634667136:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1787784400.144120:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba973 00000100:00080000:3.0:1787784400.144131:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431862b9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784400.144187:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787784400.145463:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784400.146669:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784400.146697:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784400.146704:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784400.150806:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+2:2361:x1874627634667136:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 6703us (8833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784400.150828:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00010000:00010000:1.0:1787784400.500936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784401.204676:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643087104:0@lo:400:kworker.0 00000100:00100000:2.0:1787784401.204955:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784401.205031:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784401.205038:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643087232:0@lo:400:kworker.0 00000100:00100000:2.0:1787784401.205066:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784401.205106:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087232 00000100:00100000:2.0:1787784401.205114:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087232 00000100:00100000:2.0:1787784401.205192:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784401.205204:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643087232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784401.205260:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643087232:12345-0@lo:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784401.205267:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787784401.205289:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784401.205323:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943189160f00 x1874627643087232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784401.205339:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643087232:0@lo:400:kworker.0 00000100:00100000:3.0:1787784401.205472:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643086976:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205504:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643086848:0@lo:400:kworker.0 00000100:00100000:3.0:1787784401.205505:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784401.205534:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643087488:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784401.205555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784401.205563:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643087360:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205583:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784401.205612:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086848 00000100:00100000:0.0:1787784401.205616:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086848 00000100:00100000:0.0:1787784401.205655:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787784401.205662:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643086848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205710:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643086848:12345-0@lo:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784401.205717:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787784401.205757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087104 00000100:00100000:0.0:1787784401.205761:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087104 00000100:00100000:0.0:1787784401.205785:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643086976 00000100:00100000:0.0:1787784401.205787:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643086976 00000100:00100000:0.0:1787784401.205801:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087360 00000100:00100000:0.0:1787784401.205804:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087360 00000100:00100000:0.0:1787784401.205827:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784401.205833:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643087104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205863:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643087104:12345-0@lo:400:kworker.0 Request processed in 30us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784401.205869:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787784401.205879:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784401.205893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643086976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205920:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643086976:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784401.205926:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787784401.205936:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784401.205941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643087360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.205959:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643087360:12345-0@lo:400:kworker.0 Request processed in 19us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784401.205965:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784401.205994:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643086976:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.206012:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643086848:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.206020:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643087360:0@lo:400:kworker.0 00000100:00080000:2.0:1787784401.207995:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784401.208054:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643087104:0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.210488:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087488 00000100:00100000:0.0:1787784401.210513:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087488 00000100:00100000:0.0:1787784401.210620:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784401.210634:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643087488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784401.210768:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643087488:12345-0@lo:400:kworker.0 Request processed in 136us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784401.210776:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787784401.210833:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431891603c0 x1874627643087488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784401.210850:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643087488:0@lo:400:kworker.0 00000100:00080000:2.0:1787784401.211063:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787784401.525015:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784401.718021:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784401.718114:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784401.718289:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087616 00000100:00100000:1.0:1787784401.718298:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087616 00000100:00100000:1.0:1787784401.718357:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787784401.718390:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643087616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784401.718429:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784401.718522:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643087616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784401.718529:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787784401.718571:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962912c0 x1874627643087616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784401.718590:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643087616:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787784402.345917:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:1.0:1787784402.345931:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431862bc000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:3.0:1787784402.346060:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431862bc000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-OST0000 00000020:00000080:3.0:1787784402.346127:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431862b8000 for lustre-OST0000 00010000:00010000:0.0:1787784402.558991:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784403.573942:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784404.605006:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784404.790038:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784404.790138:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784404.791395:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087744 00000100:00100000:2.0:1787784404.791406:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087744 00000100:00100000:2.0:1787784404.791470:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784404.791479:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643087744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784404.791516:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784404.791577:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643087744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784404.791602:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787784404.792051:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784404.792162:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedd680 x1874627643087744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784404.792185:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643087744:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787784404.860173:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:2.0:1787784404.860182:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431862be000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:3.0:1787784404.860270:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431862be000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-OST0001 00000020:00000080:3.0:1787784404.860325:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431862b9000 for lustre-OST0001 00000100:00100000:2.0:1787784405.251707:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784405.251767:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784405.251835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667264 00000100:00100000:3.0:1787784405.251856:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667264 00000100:00100000:3.0:1787784405.251959:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:3.0:1787784405.251970:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634667264:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784405.252049:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634667264:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 81us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784405.252056:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:0.0:1787784405.252192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667392 00000100:00100000:0.0:1787784405.252198:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667392 00000100:00100000:0.0:1787784405.252242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1787784405.252250:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634667392:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784405.252285:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634667392:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784405.252292:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00080000:0.0:1787784405.252457:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784405.621472:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784406.325701:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643088000:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.325941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326004:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643088512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326066:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784406.326072:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643087872:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326199:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643088384:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326224:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326252:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643088128:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326294:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326317:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784406.326322:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643088256:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326345:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784406.326464:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088000 00000100:00100000:0.0:1787784406.326473:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088000 00000100:00100000:0.0:1787784406.326523:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088384 00000100:00100000:0.0:1787784406.326532:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088384 00000100:00100000:0.0:1787784406.326560:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088128 00000100:00100000:0.0:1787784406.326563:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088128 00000100:00100000:0.0:1787784406.326580:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784406.326588:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643088000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326708:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643088000:12345-0@lo:400:kworker.0 Request processed in 59us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.326717:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787784406.326735:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784406.326742:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643088384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326917:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643088384:12345-0@lo:400:kworker.0 Request processed in 100us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.326925:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787784406.326938:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784406.326945:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b41992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643088128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.326978:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b41992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643088128:12345-0@lo:400:kworker.0 Request processed in 35us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.326985:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784406.327004:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088512 00000100:00100000:0.0:1787784406.327007:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088512 00000100:00100000:0.0:1787784406.327033:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088256 00000100:00100000:0.0:1787784406.327036:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088256 00000100:00100000:0.0:1787784406.327061:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784406.327067:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643088512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.327246:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643088512:12345-0@lo:400:kworker.0 Request processed in 33us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.327253:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784406.327273:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784406.327279:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643088256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.327311:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643088256:12345-0@lo:400:kworker.0 Request processed in 33us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.327317:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784406.327336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643087872 00000100:00100000:0.0:1787784406.327340:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643087872 00000100:00100000:0.0:1787784406.327510:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787784406.327518:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643087872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.327550:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643087872:12345-0@lo:400:kworker.0 Request processed in 33us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784406.327556:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1787784406.327980:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784406.327986:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784406.327989:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784406.328036:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac4f00 x1874627643088256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784406.328052:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643088256:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.328066:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643088128:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.328113:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643087872:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.328125:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643088384:0@lo:400:kworker.0 00000100:00100000:0.0:1787784406.328137:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643088000:0@lo:400:kworker.0 00010000:00080000:0.0:1787784406.328148:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba342580 x1874627643088512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784406.328171:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643088512:0@lo:400:kworker.0 00010000:00010000:0.0:1787784406.645532:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784406.836037:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing yml_node 00000100:00100000:1.0:1787784406.837881:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784406.837909:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643088640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784406.838007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784406.838184:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088640 00000100:00100000:2.0:1787784406.838193:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088640 00000100:00100000:2.0:1787784406.838265:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784406.838275:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643088640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784406.838316:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784406.838546:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643088640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784406.838554:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787784406.839353:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedf840 x1874627643088640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784406.839411:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643088640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784407.673640:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784408.695688:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784409.720614:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784409.909267:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643088768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784409.909393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784409.909901:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088768 00000100:00100000:2.0:1787784409.909916:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088768 00000100:00100000:2.0:1787784409.910010:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784409.910023:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643088768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784409.910081:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784409.910149:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643088768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784409.910157:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787784409.910209:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedcf00 x1874627643088768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784409.910234:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643088768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784409.911414:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784410.359856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784410.360007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784410.360139:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667648 00000100:00100000:3.0:1787784410.360144:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667520 00000100:00100000:3.0:1787784410.360152:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667520 00000100:00100000:0.0:1787784410.360152:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667648 00000100:00100000:3.0:1787784410.360222:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:0.0:1787784410.360225:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1787784410.360234:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634667520:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784410.360234:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634667648:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784410.360324:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634667648:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 92us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784410.360332:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00080000:1.0:1787784410.360338:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784410.363886:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2365:x1874627634667520:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3635us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784410.363905:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 200 00010000:00010000:3.0:1787784410.741795:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784411.455889:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643089280:0@lo:400:kworker.0 00000100:00100000:1.0:1787784411.455989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784411.456090:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784411.456097:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643089152:0@lo:400:kworker.0 00000100:00100000:1.0:1787784411.456157:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784411.456286:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643088896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784411.456393:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643089408:0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784411.456455:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787784411.456460:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643089024:0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784411.456515:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643089536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456540:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784411.456596:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089152 00000100:00100000:3.0:1787784411.456728:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089152 00000100:00100000:3.0:1787784411.456799:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089408 00000100:00100000:3.0:1787784411.456803:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089408 00000100:00100000:3.0:1787784411.456825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089024 00000100:00100000:3.0:1787784411.456829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089024 00000100:00100000:3.0:1787784411.456847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784411.456857:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643089152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456925:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643089152:12345-0@lo:400:kworker.0 Request processed in 69us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784411.456934:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784411.456958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787784411.456964:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643089408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.456999:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643089408:12345-0@lo:400:kworker.0 Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784411.457005:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787784411.457017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784411.457023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643089024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.457061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643089024:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784411.457068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787784411.457092:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089280 00000100:00100000:3.0:1787784411.457095:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089280 00000100:00100000:3.0:1787784411.457125:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089536 00000100:00100000:3.0:1787784411.457128:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089536 00000100:00100000:3.0:1787784411.457151:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784411.457157:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643089280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.457188:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643089280:12345-0@lo:400:kworker.0 Request processed in 31us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784411.457202:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784411.457214:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784411.457220:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643089536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.457249:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643089536:12345-0@lo:400:kworker.0 Request processed in 29us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784411.457255:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787784411.457273:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784411.457276:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784411.457278:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784411.457321:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643089024:0@lo:400:kworker.0 00010000:00080000:3.0:1787784411.457338:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431971161c0 x1874627643089536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784411.457349:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643089536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784411.457360:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643089408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784411.459871:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643089152:0@lo:400:kworker.0 00010000:00080000:0.0:1787784411.459898:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943197115e00 x1874627643089280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784411.459911:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643089280:0@lo:400:kworker.0 00000100:00100000:1.0:1787784411.460275:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643088896 00000100:00100000:1.0:1787784411.460285:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643088896 00000100:00100000:1.0:1787784411.460345:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787784411.460356:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643088896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784411.460470:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643088896:12345-0@lo:400:kworker.0 Request processed in 117us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784411.460478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787784411.468247:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643088896:0@lo:400:kworker.0 00010000:00010000:0.0:1787784411.775355:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784411.959744:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784411.959776:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643089664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784411.959886:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784411.959956:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089664 00000100:00100000:0.0:1787784411.959968:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089664 00000100:00100000:0.0:1787784411.960037:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784411.960057:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643089664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784411.960106:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784411.960171:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643089664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784411.960179:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787784411.960532:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9c3c0 x1874627643089664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784411.960555:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643089664:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787784412.353686:0:9238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.54 00010000:00010000:2.0:1787784412.788958:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784413.834086:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784414.837986:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784415.038323:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784415.038351:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643089792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784415.039001:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784415.039128:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089792 00000100:00100000:3.0:1787784415.039294:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089792 00000100:00100000:3.0:1787784415.039415:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784415.039430:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643089792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784415.039480:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784415.039536:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643089792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784415.039560:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787784415.039674:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784415.039710:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedb0c0 x1874627643089792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784415.039730:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643089792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784415.480164:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784415.480220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784415.480328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667904 00000100:00100000:1.0:1787784415.480345:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667904 00000100:00100000:3.0:1787784415.480408:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634667776 00000100:00100000:3.0:1787784415.480419:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634667776 00000100:00100000:1.0:1787784415.480484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1787784415.480498:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634667904:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:2.0:1787784415.480542:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784415.480607:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beede580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634667904:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784415.480643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1787784415.480844:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:3.0:1787784415.480854:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634667776:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784415.480914:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634667776:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 63us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784415.480920:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 202 00010000:00010000:2.0:1787784415.864425:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784415.958053:0:9337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.54 00000100:00100000:3.0:1787784416.565044:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643089920:0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784416.565244:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643090432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784416.565267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643089920 00000100:00100000:0.0:1787784416.565279:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643089920 00000100:00100000:3.0:1787784416.565291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784416.565324:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787784416.565330:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643090048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784416.565351:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787784416.565353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784416.565386:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643089920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565398:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643090560:0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565427:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784416.565457:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643089920:12345-0@lo:400:kworker.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784416.565467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787784416.565721:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643089920:0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565755:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090432 00000100:00100000:3.0:1787784416.565782:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090432 00000100:00100000:3.0:1787784416.565837:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090048 00000100:00080000:0.0:1787784416.565837:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784416.565840:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090048 00000100:00100000:3.0:1787784416.565874:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787784416.565882:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643090432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565928:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643090432:12345-0@lo:400:kworker.0 Request processed in 47us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784416.565935:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787784416.565949:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787784416.565955:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643090048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.565983:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643090048:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784416.565989:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787784416.566027:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090560 00000100:00100000:3.0:1787784416.566032:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090560 00000100:00100000:3.0:1787784416.566067:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787784416.566073:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784416.566208:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643090176:0@lo:400:kworker.0 00000100:00100000:2.0:1787784416.570858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784416.570945:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784416.570961:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643090304:0@lo:400:kworker.0 00000100:00100000:2.0:1787784416.571035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784416.571418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090176 00000100:00100000:1.0:1787784416.571432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090176 00000100:00100000:1.0:1787784416.571525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784416.571537:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643090176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784416.571620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643090176:12345-0@lo:400:kworker.0 Request processed in 86us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784416.571629:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784416.572041:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643090176:0@lo:400:kworker.0 00000100:00100000:2.0:1787784416.572661:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643090048:0@lo:400:kworker.0 00000100:00100000:2.0:1787784416.572678:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643090432:0@lo:400:kworker.0 00000100:00100000:0.0:1787784416.573050:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090304 00000100:00100000:0.0:1787784416.573059:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090304 00000100:00100000:0.0:1787784416.573117:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787784416.573128:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784416.573207:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643090304:12345-0@lo:400:kworker.0 Request processed in 81us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784416.573214:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787784416.573858:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4199680 x1874627643090304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784416.573874:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643090304:0@lo:400:kworker.0 00000100:00100000:3.0:1787784416.575204:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643090560:12345-0@lo:400:kworker.0 Request processed in 9121us (9765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784416.575221:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787784416.575438:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784416.575455:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787784416.575588:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419b840 x1874627643090560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784416.575605:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643090560:0@lo:400:kworker.0 00010000:00010000:0.0:1787784416.885652:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784417.089839:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784417.089876:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643090688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784417.089990:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784417.090532:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090688 00000100:00100000:1.0:1787784417.090543:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090688 00000100:00100000:1.0:1787784417.090656:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784417.090670:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643090688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784417.090716:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784417.090785:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643090688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784417.090793:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787784417.090845:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9e1c0 x1874627643090688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784417.090870:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643090688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787784417.910633:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784418.797226:0:9434:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.54 00010000:00010000:1.0:1787784418.932586:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784419.960828:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784420.150756:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643090816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784420.150876:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784420.151007:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090816 00000100:00100000:0.0:1787784420.151017:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090816 00000100:00100000:0.0:1787784420.151108:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787784420.151121:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643090816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784420.151168:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784420.151224:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643090816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784420.151249:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787784420.151297:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419a940 x1874627643090816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784420.151318:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643090816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784420.152433:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784420.607993:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784420.608053:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784420.608181:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668032 00000100:00100000:3.0:1787784420.608193:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668032 00000100:00100000:3.0:1787784420.608265:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:3.0:1787784420.608275:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634668032:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784420.608400:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634668032:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 125us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784420.608409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668160 00000100:00100000:0.0:1787784420.608413:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668160 00000100:00100000:3.0:1787784420.608417:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:0.0:1787784420.608473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:0.0:1787784420.608481:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634668160:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784420.608517:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beede1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634668160:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784420.608532:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00080000:0.0:1787784420.608554:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787784420.699916:0:9483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 18:46:59 EDT 2026 00010000:00010000:3.0:1787784420.982934:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784421.688411:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643091200:0@lo:400:kworker.0 00000100:00100000:1.0:1787784421.688510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784421.688625:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784421.688632:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643091328:0@lo:400:kworker.0 00000100:00100000:1.0:1787784421.688664:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784421.688713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091200 00000100:00100000:1.0:1787784421.688724:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091200 00000100:00100000:1.0:1787784421.688804:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784421.688818:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643091200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784421.688885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643091200:12345-0@lo:400:kworker.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784421.688893:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784421.688921:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091328 00000100:00100000:1.0:1787784421.688925:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091328 00000100:00100000:1.0:1787784421.688954:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784421.688973:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643091328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784421.689008:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643091328:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784421.689014:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787784421.689032:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784421.689075:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9f480 x1874627643091328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784421.689093:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643091328:0@lo:400:kworker.0 00000100:00100000:1.0:1787784421.689105:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643091200:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689199:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643091072:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784421.689267:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643091584:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784421.689322:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784421.689328:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643090944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784421.689403:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643091456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689426:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784421.689461:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091584 00000100:00100000:0.0:1787784421.689465:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091584 00000100:00100000:0.0:1787784421.689516:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784421.689523:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643091584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689561:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643091584:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784421.689568:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784421.689591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643090944 00000100:00100000:0.0:1787784421.689595:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643090944 00000100:00100000:0.0:1787784421.689624:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787784421.689631:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689662:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643090944:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784421.689669:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787784421.689698:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091072 00000100:00100000:0.0:1787784421.689701:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091072 00000100:00100000:0.0:1787784421.689724:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091456 00000100:00100000:0.0:1787784421.689727:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091456 00000100:00100000:0.0:1787784421.689748:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784421.689755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643091072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689787:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643091072:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784421.689793:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787784421.689804:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784421.689810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643091456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689835:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643091456:12345-0@lo:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784421.689840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784421.689878:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643090944:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689898:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643091456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784421.689907:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643091072:0@lo:400:kworker.0 00010000:00080000:0.0:1787784421.689917:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9ed00 x1874627643091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784421.689927:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643091584:0@lo:400:kworker.0 00000100:00080000:1.0:1787784421.690137:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784421.690142:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787784422.012014:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784422.196569:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784422.196619:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643091712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784422.196721:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784422.196792:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091712 00000100:00100000:3.0:1787784422.196804:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091712 00000100:00100000:3.0:1787784422.196878:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784422.196890:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643091712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784422.196949:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784422.197016:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643091712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784422.197024:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787784422.197068:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9f480 x1874627643091712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784422.197087:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643091712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787784423.028890:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784424.070193:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784425.078498:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784425.270962:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643091840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784425.271064:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784425.271162:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091840 00000100:00100000:1.0:1787784425.271171:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091840 00000100:00100000:1.0:1787784425.272377:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784425.272400:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643091840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784425.272449:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784425.274676:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643091840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2273us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784425.274697:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787784425.274739:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784425.277692:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9cf00 x1874627643091840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784425.277728:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643091840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784425.720516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784425.720574:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784425.720669:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668416 00000100:00100000:3.0:1787784425.720681:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668416 00000100:00100000:1.0:1787784425.720743:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668288 00000100:00100000:1.0:1787784425.720747:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668288 00000100:00100000:3.0:1787784425.720807:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1787784425.720813:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:3.0:1787784425.720820:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634668416:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784425.720820:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2362:x1874627634668288:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784425.722810:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634668416:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1977us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784425.722828:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1787784425.730882:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2362:x1874627634668288:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 9959us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784425.730984:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00080000:2.0:1787784425.739639:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784426.104600:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784426.805671:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643091968:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.805674:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643092224:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.806008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784426.806086:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784426.806093:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643092352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.806268:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784426.806316:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092352 00000100:00100000:1.0:1787784426.806324:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092352 00000100:00100000:1.0:1787784426.806414:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787784426.806425:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643092352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.806507:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643092352:12345-0@lo:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784426.806516:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787784426.806569:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419b840 x1874627643092352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784426.806603:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643092352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.807494:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b41983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643092096:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.807557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784426.807710:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092224 00000100:00100000:2.0:1787784426.807721:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092224 00000100:00100000:1.0:1787784426.807972:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643092608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784426.808072:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092096 00000100:00100000:2.0:1787784426.808077:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092096 00000100:00100000:1.0:1787784426.808166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784426.808221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784426.808234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643092224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.808293:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643092224:12345-0@lo:400:kworker.0 Request processed in 63us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784426.808301:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784426.808334:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092608 00000100:00100000:1.0:1787784426.808338:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092608 00000100:00100000:2.0:1787784426.808494:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787784426.808505:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643092096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784426.808553:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643092096:12345-0@lo:400:kworker.0 Request processed in 52us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784426.808559:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787784426.808576:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784426.808589:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784426.809658:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784426.809680:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643092608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.809757:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643092608:12345-0@lo:400:kworker.0 Request processed in 88us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784426.809765:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787784426.810240:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643092224:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.810291:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b41983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643092096:0@lo:400:kworker.0 00010000:00080000:1.0:1787784426.810336:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4198b40 x1874627643092608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784426.810347:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643092608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784426.812434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784426.812784:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643092480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784426.812842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784426.813176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092480 00000100:00100000:2.0:1787784426.813189:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092480 00000100:00100000:2.0:1787784426.813285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784426.813297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643092480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784426.813389:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643092480:12345-0@lo:400:kworker.0 Request processed in 94us (546us total) trans 0 rc 0/0 00000100:00080000:3.0:1787784426.813413:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784426.813417:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787784426.813508:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643092480:0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.814385:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643091968 00000100:00100000:1.0:1787784426.814393:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643091968 00000100:00100000:1.0:1787784426.814453:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787784426.814463:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643091968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784426.814541:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643091968:12345-0@lo:400:kworker.0 Request processed in 81us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784426.814548:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787784426.814625:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643091968:0@lo:400:kworker.0 00010000:00010000:3.0:1787784427.125111:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784427.319583:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784427.319619:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643092736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784427.319721:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784427.319823:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092736 00000100:00100000:3.0:1787784427.319833:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092736 00000100:00100000:3.0:1787784427.319923:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784427.319935:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643092736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784427.319984:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784427.320054:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643092736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784427.320062:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787784427.320139:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedb840 x1874627643092736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784427.320168:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643092736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784428.149292:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784429.175632:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784430.197335:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784430.392006:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784430.392037:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643092864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784430.392136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784430.392224:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092864 00000100:00100000:1.0:1787784430.392234:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092864 00000100:00100000:1.0:1787784430.392316:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784430.392327:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643092864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784430.392399:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784430.392459:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643092864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784430.392468:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787784430.392493:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784430.392534:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9ed00 x1874627643092864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784430.392557:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643092864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784430.843079:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784430.843149:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784430.843256:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668672 00000100:00100000:3.0:1787784430.843272:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668672 00000100:00100000:3.0:1787784430.843399:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:3.0:1787784430.843414:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634668672:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:0.0:1787784430.843515:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784430.843753:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668544 00000100:00100000:1.0:1787784430.843758:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668544 00000100:00100000:1.0:1787784430.843796:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 208 00000100:00100000:1.0:1787784430.843804:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2362:x1874627634668544:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784430.843867:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634668672:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 447us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784430.843887:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:1.0:1787784430.849210:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2362:x1874627634668544:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 5384us (6125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784430.849233:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 208 00010000:00010000:0.0:1787784431.225203:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784431.925026:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643092992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.925273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.925349:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643093504:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.925427:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.925471:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784431.925478:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643093120:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.925502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.925524:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643093632:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.925553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.925592:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643093248:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.925622:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.925645:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784431.925650:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643093376:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.926008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784431.926057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643092992 00000100:00100000:0.0:1787784431.926067:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643092992 00000100:00100000:0.0:1787784431.926257:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787784431.926268:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643092992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.926471:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643092992:12345-0@lo:400:kworker.0 Request processed in 204us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.926481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787784431.926527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093504 00000100:00100000:0.0:1787784431.926532:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093504 00000100:00100000:0.0:1787784431.926585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093120 00000100:00100000:0.0:1787784431.926589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093120 00000100:00100000:0.0:1787784431.926606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093248 00000100:00100000:0.0:1787784431.926609:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093248 00000100:00100000:0.0:1787784431.926628:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784431.926637:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643093504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.926858:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643093504:12345-0@lo:400:kworker.0 Request processed in 222us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.926882:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787784431.926896:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784431.926903:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643093120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.926934:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643093120:12345-0@lo:400:kworker.0 Request processed in 32us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.926940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784431.926952:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784431.926958:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643093248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.926993:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643093248:12345-0@lo:400:kworker.0 Request processed in 35us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.926999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784431.927027:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093632 00000100:00100000:0.0:1787784431.927032:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093632 00000100:00100000:0.0:1787784431.927066:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093376 00000100:00100000:0.0:1787784431.927070:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093376 00000100:00100000:0.0:1787784431.927237:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784431.927245:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643093632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.927280:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643093632:12345-0@lo:400:kworker.0 Request processed in 37us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.927286:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784431.927296:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784431.927301:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643093376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.927331:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643093376:12345-0@lo:400:kworker.0 Request processed in 30us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784431.927337:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787784431.927440:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643093120:0@lo:400:kworker.0 00010000:00080000:0.0:1787784431.927459:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4198b40 x1874627643093632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784431.927469:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643093632:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.927478:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643092992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.927489:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643093504:0@lo:400:kworker.0 00000100:00080000:0.0:1787784431.927535:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784431.927541:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784431.927569:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419a1c0 x1874627643093376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784431.927580:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643093376:0@lo:400:kworker.0 00000100:00100000:0.0:1787784431.927592:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643093248:0@lo:400:kworker.0 00010000:00010000:3.0:1787784432.245038:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784432.439860:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beeda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643093760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784432.439958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784432.440146:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093760 00000100:00100000:3.0:1787784432.440155:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093760 00000100:00100000:3.0:1787784432.440214:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784432.440224:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643093760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784432.440267:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784432.440320:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643093760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784432.440339:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787784432.442263:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beeda580 x1874627643093760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784432.442294:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beeda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643093760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784433.269075:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784434.294692:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784435.316809:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784435.510432:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643093888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784435.510542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784435.510667:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643093888 00000100:00100000:3.0:1787784435.510679:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643093888 00000100:00100000:3.0:1787784435.510746:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784435.510757:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643093888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784435.510807:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784435.510873:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643093888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784435.510882:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787784435.510937:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedd2c0 x1874627643093888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784435.511175:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643093888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784435.511594:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784435.965403:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784435.965458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784435.965560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668928 00000100:00100000:0.0:1787784435.965576:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668928 00000100:00100000:0.0:1787784435.965685:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:0.0:1787784435.965699:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634668928:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784435.965813:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634668928:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 118us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784435.965821:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00080000:2.0:1787784435.966478:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784435.967183:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634668800 00000100:00100000:1.0:1787784435.967201:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634668800 00000100:00100000:1.0:1787784435.967278:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:1.0:1787784435.967302:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634668800:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784435.967617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2364:x1874627634668800:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 328us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784435.967626:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 210 00010000:00010000:3.0:1787784436.340600:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784437.048666:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643094144:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.048784:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.048914:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643094656:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.048942:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.048980:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787784437.048985:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643094016:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.049030:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643094528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049047:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.049071:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094400:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.049106:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784437.049110:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643094272:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049128:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784437.049160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094144 00000100:00100000:0.0:1787784437.049170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094144 00000100:00100000:0.0:1787784437.049223:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094528 00000100:00100000:0.0:1787784437.049226:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094528 00000100:00100000:0.0:1787784437.049256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094272 00000100:00100000:0.0:1787784437.049258:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094272 00000100:00100000:0.0:1787784437.049279:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784437.049288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643094144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643094144:12345-0@lo:400:kworker.0 Request processed in 58us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784437.049354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787784437.049393:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784437.049399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784437.049406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643094528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049430:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643094528:12345-0@lo:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784437.049446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784437.049457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784437.049462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643094272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.049497:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643094272:12345-0@lo:400:kworker.0 Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784437.049503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784437.049521:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094656 00000100:00100000:0.0:1787784437.049524:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094656 00000100:00080000:2.0:1787784437.049568:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784437.049615:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643094272:0@lo:400:kworker.0 00000100:00100000:2.0:1787784437.052550:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094400 00000100:00100000:2.0:1787784437.052574:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094400 00000100:00100000:2.0:1787784437.052689:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784437.052707:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643094656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784437.052965:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643094656:12345-0@lo:400:kworker.0 Request processed in 265us (4020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784437.052974:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787784437.053007:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784437.053016:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784437.053057:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094400:12345-0@lo:400:kworker.0 Request processed in 43us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784437.053064:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784437.053095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094016 00000100:00100000:2.0:1787784437.053099:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094016 00000100:00100000:2.0:1787784437.053127:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787784437.053134:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643094016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784437.053192:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643094016:12345-0@lo:400:kworker.0 Request processed in 58us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784437.053199:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787784437.053283:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643094016:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.053308:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643094528:0@lo:400:kworker.0 00000100:00100000:0.0:1787784437.053326:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643094144:0@lo:400:kworker.0 00010000:00080000:0.0:1787784437.053345:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4199e00 x1874627643094656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784437.053357:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784437.053358:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643094656:0@lo:400:kworker.0 00010000:00080000:2.0:1787784437.054192:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4199680 x1874627643094400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784437.054207:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094400:0@lo:400:kworker.0 00010000:00010000:0.0:1787784437.365133:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784437.561243:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784437.561281:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784437.561404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784437.561522:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094784 00000100:00100000:2.0:1787784437.561532:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094784 00000100:00100000:2.0:1787784437.561593:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784437.561604:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784437.561650:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784437.561705:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784437.561713:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787784437.561764:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedf840 x1874627643094784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784437.561787:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094784:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787784437.770988:0:10112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:47:16 (1787784436) === 00000100:00100000:2.0:1787784438.270889:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.273349:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669056 00000100:00100000:0.0:1787784438.273437:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669056 00000100:00100000:0.0:1787784438.273521:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:0.0:1787784438.273534:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:8161:x1874627634669056:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784438.273556:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784438.273582:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943180030a00/0xffb8d925c20baa37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8be expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.273624:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943180030a00/0xffb8d925c20baa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8be expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.273659:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943180030a00/0xffb8d925c20baa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8be expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784438.273670:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030a00, rc 0) 00000100:00100000:0.0:1787784438.273770:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669056:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 238us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.273778:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:2.0:1787784438.281771:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.287309:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669184 00000100:00100000:0.0:1787784438.287332:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669184 00000100:00100000:0.0:1787784438.287484:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:0.0:1787784438.287497:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669184:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784438.287938:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669184:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 443us (6184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.287948:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:2.0:1787784438.290994:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.291130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669312 00000100:00100000:1.0:1787784438.291145:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669312 00000100:00100000:1.0:1787784438.291228:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:1.0:1787784438.291239:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669312:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784438.291591:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669312:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 352us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.291600:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:3.0:1787784438.296535:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784438.301240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669440 00000100:00100000:2.0:1787784438.301261:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669440 00000100:00100000:1.0:1787784438.304031:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:1.0:1787784438.304067:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8165:x1874627634669440:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784438.304519:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8165:x1874627634669440:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 470us (7996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.304529:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:2.0:1787784438.331581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.331801:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669568 00000100:00100000:0.0:1787784438.331823:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669568 00000100:00100000:0.0:1787784438.331964:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:0.0:1787784438.331977:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8165:x1874627634669568:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784438.332341:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8165:x1874627634669568:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 365us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.332350:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:3.0:1787784438.342320:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784438.342483:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669696 00000100:00100000:2.0:1787784438.342498:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669696 00000100:00100000:2.0:1787784438.342578:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:2.0:1787784438.342591:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:8161:x1874627634669696:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787784438.342617:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784438.342643:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f0c00/0xffb8d925c20baa3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8e8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784438.342685:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f0c00/0xffb8d925c20baa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784438.342699:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f0c00/0xffb8d925c20baa3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784438.342709:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0c00, rc 0) 00000100:00100000:2.0:1787784438.342797:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:8161:x1874627634669696:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 208us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784438.342805:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:3.0:1787784438.358585:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.359559:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669824 00000100:00100000:0.0:1787784438.359577:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669824 00000100:00100000:0.0:1787784438.360149:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:0.0:1787784438.360165:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:8161:x1874627634669824:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787784438.360226:0:5825:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784438.360247:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784438.360252:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784438.360255:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784438.360258:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787784438.366471:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:8161:x1874627634669824:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 6291us (7887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.366490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:3.0:1787784438.369538:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.369642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634669952 00000100:00100000:1.0:1787784438.369656:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634669952 00000100:00100000:1.0:1787784438.369717:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:1.0:1787784438.369726:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:8161:x1874627634669952:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787784438.369750:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784438.369776:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a8ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784438.369835:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784438.369851:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784438.369863:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784438.370435:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8161:x1874627634669952:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 704us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.370445:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:3.0:1787784438.372796:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.372904:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670080 00000100:00100000:1.0:1787784438.372915:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670080 00000100:00100000:1.0:1787784438.372982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:1.0:1787784438.372993:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8161:x1874627634670080:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787784438.373546:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8161:x1874627634670080:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 552us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.373554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:2.0:1787784438.376037:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.376159:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670208 00000100:00100000:1.0:1787784438.376172:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670208 00000100:00100000:1.0:1787784438.376261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:1.0:1787784438.376270:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8161:x1874627634670208:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787784438.376632:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8161:x1874627634670208:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 362us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.376640:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:3.0:1787784438.379731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.379807:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670336 00000100:00100000:0.0:1787784438.379829:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670336 00000100:00100000:0.0:1787784438.379897:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 222 00000100:00100000:0.0:1787784438.379906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8168:x1874627634670336:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784438.380348:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8168:x1874627634670336:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 442us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.380355:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 222 00000100:00100000:3.0:1787784438.383908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.384166:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670464 00000100:00100000:1.0:1787784438.384182:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670464 00000100:00100000:1.0:1787784438.384261:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:1.0:1787784438.384275:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8168:x1874627634670464:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784438.384705:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:8168:x1874627634670464:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 433us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.384712:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:1.0:1787784438.387911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.387979:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.388085:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670976 00000100:00100000:0.0:1787784438.388099:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670976 00000100:00100000:0.0:1787784438.388173:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670592 00000100:00100000:0.0:1787784438.388176:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670592 00000100:00100000:0.0:1787784438.388191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1787784438.388201:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634670976:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784438.388278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634670976:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.388284:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1787784438.388299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784438.388302:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874627634670592:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784438.388324:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2dcd91ed-fe78-44b1-8596-d4df1b711f35@192.168.202.59@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1787784438.388476:0:5833:0:(genops.c:1385:class_connect()) connect: client 2dcd91ed-fe78-44b1-8596-d4df1b711f35, cookie 0xffb8d925c20baa4c 00000004:00100000:0.0:1787784438.388509:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787784438.388925:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9431862b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784438.388963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2361:x1874627634670592:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 657us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.388971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00080000:1.0:1787784438.389974:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784438.390966:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784438.391446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.391693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670720 00000100:00100000:0.0:1787784438.391706:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670720 00000100:00100000:0.0:1787784438.391856:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784438.391869:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:0:x1874627634670720:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784438.391953:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784438.392062:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:0:x1874627634670720:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 197us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.392068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1787784438.395107:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784438.395692:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634670848 00000100:00100000:0.0:1787784438.395705:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634670848 00000100:00100000:0.0:1787784438.395775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784438.395786:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634670848:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784438.395838:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784438.395937:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634670848:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 153us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784438.395946:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1787784438.398183:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784438.398288:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671104 00000100:00100000:2.0:1787784438.398298:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671104 00000100:00100000:2.0:1787784438.398353:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784438.398396:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634671104:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787784438.398478:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634671104:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784438.398483:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00080000:1.0:1787784438.404099:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784438.405165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784438.405202:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784438.409172:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784438.409513:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671232 00000100:00100000:1.0:1787784438.409525:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671232 00000100:00100000:1.0:1787784438.409566:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671360 00000100:00100000:1.0:1787784438.409570:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671360 00000100:00100000:1.0:1787784438.409591:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1787784438.409601:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874627634671232:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787784438.409646:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2dcd91ed-fe78-44b1-8596-d4df1b711f35@192.168.202.59@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1787784438.409689:0:6677:0:(genops.c:1385:class_connect()) connect: client 2dcd91ed-fe78-44b1-8596-d4df1b711f35, cookie 0xffb8d925c20baa53 00002000:00100000:1.0:1787784438.409702:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2dcd91ed-fe78-44b1-8596-d4df1b711f35/ffff9431b3c6e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784438.409727:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787784438.410023:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787784438.410058:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9431b3c6b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784438.410169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671488 00000100:00100000:2.0:1787784438.410173:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671488 00000100:00100000:2.0:1787784438.410207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1787784438.410213:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634671488:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787784438.410448:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787784438.410586:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:8161:x1874627634671488:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 372us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784438.410596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1787784438.410631:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784438.410636:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634671360:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787784438.410656:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2dcd91ed-fe78-44b1-8596-d4df1b711f35@192.168.202.59@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1787784438.410672:0:6679:0:(genops.c:1385:class_connect()) connect: client 2dcd91ed-fe78-44b1-8596-d4df1b711f35, cookie 0xffb8d925c20baa5a 00002000:00100000:2.0:1787784438.410680:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2dcd91ed-fe78-44b1-8596-d4df1b711f35/ffff9431bee79800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787784438.410687:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1787784438.410839:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787784438.410864:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9431bee7a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784438.410891:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beede940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2361:x1874627634671360:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 254us (5688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784438.410897:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784438.411472:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2361:x1874627634671232:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1871us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784438.411478:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:1.0:1787784439.413646:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784440.439212:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784440.628762:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784440.628891:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784440.628993:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643094912 00000100:00100000:3.0:1787784440.629003:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643094912 00000100:00100000:3.0:1787784440.629084:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784440.629096:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784440.629144:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784440.629200:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643094912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784440.629208:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787784440.629256:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed8000 x1874627643094912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784440.629277:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643094912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784440.629506:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787784440.689038:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000001:00100000:0.0:1787784440.707112:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00010000:00010000:1.0:1787784441.463127:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784442.164674:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643095040:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.164796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.164859:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643095552:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.164905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.164941:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787784442.164948:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643095168:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.164972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.164991:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643095680:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.165090:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643095296:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165116:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.165135:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784442.165142:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643095424:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165165:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784442.165201:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095040 00000100:00100000:0.0:1787784442.165212:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095040 00000100:00100000:0.0:1787784442.165273:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787784442.165283:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165357:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643095040:12345-0@lo:400:kworker.0 Request processed in 75us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165396:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787784442.165439:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095552 00000100:00100000:0.0:1787784442.165443:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095552 00000100:00100000:0.0:1787784442.165486:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095168 00000100:00100000:0.0:1787784442.165489:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095168 00000100:00100000:0.0:1787784442.165506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095296 00000100:00100000:0.0:1787784442.165509:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095296 00000100:00100000:0.0:1787784442.165524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784442.165530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165566:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643095552:12345-0@lo:400:kworker.0 Request processed in 36us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784442.165596:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784442.165601:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643095168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165628:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643095168:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165634:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784442.165645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784442.165650:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643095296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643095296:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784442.165707:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095680 00000100:00100000:0.0:1787784442.165711:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095680 00000100:00100000:0.0:1787784442.165734:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095424 00000100:00100000:0.0:1787784442.165737:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095424 00000100:00100000:0.0:1787784442.165758:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784442.165765:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643095680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165809:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643095680:12345-0@lo:400:kworker.0 Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165815:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784442.165826:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787784442.165832:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165858:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643095424:12345-0@lo:400:kworker.0 Request processed in 27us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784442.165863:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787784442.165892:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784442.165897:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784442.165899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784442.165946:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac4f00 x1874627643095424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784442.165963:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643095424:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.165975:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643095296:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.166026:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643095168:0@lo:400:kworker.0 00010000:00080000:0.0:1787784442.166038:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4199680 x1874627643095680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784442.166046:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643095680:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.166055:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643095040:0@lo:400:kworker.0 00000100:00100000:0.0:1787784442.166065:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643095552:0@lo:400:kworker.0 00010000:00010000:0.0:1787784442.484584:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784442.676858:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784442.676889:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643095808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784442.677002:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784442.677183:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095808 00000100:00100000:2.0:1787784442.677194:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095808 00000100:00100000:2.0:1787784442.677255:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784442.677267:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643095808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784442.677342:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784442.677427:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643095808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784442.677434:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787784442.679720:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedd2c0 x1874627643095808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784442.679758:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643095808:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787784443.271951:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00010000:00010000:1.0:1787784443.508737:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784443.655965:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784443.656013:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784443.656457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784443.656519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784443.656595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671616 00000100:00100000:1.0:1787784443.656615:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671616 00000100:00100000:2.0:1787784443.656783:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672128 00000100:00100000:2.0:1787784443.656788:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672128 00000100:00100000:2.0:1787784443.656898:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1787784443.656913:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634672128:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784443.657036:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634672128:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 127us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784443.657052:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00080000:2.0:1787784443.657328:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784443.658051:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:1.0:1787784443.658071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634671616:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784443.659939:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634671616:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1864us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784443.659973:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:0.0:1787784443.662812:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671872 00000100:00100000:0.0:1787784443.662829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671872 00000100:00100000:0.0:1787784443.662912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634671744 00000100:00100000:0.0:1787784443.662917:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634671744 00000100:00100000:0.0:1787784443.662948:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:0.0:1787784443.662959:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634671872:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784443.663050:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634671872:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 92us (7036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784443.663059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1787784443.664919:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784443.665106:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672000 00000100:00100000:3.0:1787784443.665115:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672000 00000100:00100000:3.0:1787784443.665173:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1787784443.665183:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634672000:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784443.665277:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634672000:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 96us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784443.665286:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00080000:1.0:1787784443.665331:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784443.665338:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784443.665397:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:1.0:1787784443.665410:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634671744:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784443.665466:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634671744:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 60us (8946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784443.665474:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00010000:00010000:1.0:1787784444.545819:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787784444.935636:0:10310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787784445.556669:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784445.749933:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643095936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784445.750032:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784445.750151:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643095936 00000100:00100000:1.0:1787784445.750161:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643095936 00000100:00100000:1.0:1787784445.750232:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787784445.750243:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643095936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784445.750294:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784445.750343:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643095936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784445.750350:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787784445.750399:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784445.750436:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9680 x1874627643095936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784445.750459:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643095936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784446.580702:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784447.287064:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643096064:0@lo:400:kworker.0 00000100:00100000:2.0:1787784447.287071:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643096320:0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.287170:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643096192:0@lo:400:kworker.0 00000100:00100000:2.0:1787784447.297197:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784447.297271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784447.298079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096320 00000100:00100000:2.0:1787784447.298098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096320 00000100:00080000:1.0:1787784447.298188:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784447.298212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096192 00000100:00100000:2.0:1787784447.298216:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096192 00000100:00100000:2.0:1787784447.298263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784447.298277:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643096320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.298309:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787784447.298324:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643096192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.298403:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643096192:12345-0@lo:400:kworker.0 Request processed in 85us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784447.298411:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787784447.298469:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643096192:0@lo:400:kworker.0 00000100:00100000:2.0:1787784447.298532:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643096320:12345-0@lo:400:kworker.0 Request processed in 242us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784447.298540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784447.298574:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643096320:0@lo:400:kworker.0 00000100:00100000:2.0:1787784447.298643:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784447.298654:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643096448:0@lo:400:kworker.0 00000100:00100000:2.0:1787784447.298851:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784447.298950:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096448 00000100:00100000:1.0:1787784447.298956:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096448 00000100:00100000:1.0:1787784447.298998:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787784447.299007:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643096448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.299057:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643096448:12345-0@lo:400:kworker.0 Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784447.299064:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787784447.299081:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784447.299091:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643096704:0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.299130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784447.299152:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096704 00000100:00100000:1.0:1787784447.299156:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096704 00000100:00100000:1.0:1787784447.299198:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787784447.299205:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643096704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.299238:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643096704:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784447.299245:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787784447.299271:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787784447.299447:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedd2c0 x1874627643096704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784447.299460:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643096704:0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.299476:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784447.299482:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643096576:0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.299508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784447.299532:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096576 00000100:00100000:1.0:1787784447.299535:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096576 00000100:00100000:1.0:1787784447.299569:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787784447.299575:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643096576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.300077:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643096576:12345-0@lo:400:kworker.0 Request processed in 500us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784447.300086:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787784447.300108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784447.300131:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643096576:0@lo:400:kworker.0 00010000:00080000:2.0:1787784447.305138:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beede940 x1874627643096448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784447.305162:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beede940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643096448:0@lo:400:kworker.0 00000100:00100000:1.0:1787784447.306408:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784447.306545:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096064 00000100:00100000:0.0:1787784447.306556:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096064 00000100:00100000:0.0:1787784447.306770:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787784447.306783:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643096064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784447.306879:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643096064:12345-0@lo:400:kworker.0 Request processed in 100us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784447.306887:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787784447.306998:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643096064:0@lo:400:kworker.0 00010000:00010000:0.0:1787784447.613200:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784447.796780:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784447.796829:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643096832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784447.796926:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784447.797064:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096832 00000100:00100000:2.0:1787784447.797076:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096832 00000100:00100000:2.0:1787784447.797144:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784447.797156:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643096832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784447.797199:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784447.797259:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643096832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784447.797268:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787784447.797595:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beedda40 x1874627643096832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784447.797622:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643096832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784448.630233:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784448.760848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784448.760911:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784448.760944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784448.760967:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784448.761008:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784448.761044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672512 00000100:00100000:2.0:1787784448.761059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672512 00000100:00080000:0.0:1787784448.761135:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784448.761144:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672384 00000100:00100000:2.0:1787784448.761148:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672384 00000100:00100000:2.0:1787784448.761189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:2.0:1787784448.761201:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672512:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:0.0:1787784448.761252:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784448.761319:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672512:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 120us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784448.761338:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:2.0:1787784448.761358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:2.0:1787784448.761398:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634672384:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784448.761428:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634672384:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 64us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784448.761434:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:2.0:1787784448.761456:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672768 00000100:00100000:2.0:1787784448.761460:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672768 00000100:00100000:2.0:1787784448.761493:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672640 00000100:00100000:2.0:1787784448.761496:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672640 00000100:00100000:2.0:1787784448.761518:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1787784448.761525:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672768:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:0.0:1787784448.761546:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784448.761549:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784448.761559:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672768:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 34us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784448.761565:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1787784448.761577:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1787784448.761583:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672640:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784448.761608:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634672640:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784448.761613:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:1.0:1787784448.762082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672256 00000100:00100000:1.0:1787784448.762089:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672256 00000100:00100000:1.0:1787784448.762137:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:1.0:1787784448.762153:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634672256:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784448.762199:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634672256:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 48us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784448.762205:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 227 00010000:00010000:0.0:1787784449.653555:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784450.686005:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784450.868798:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784450.868830:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643096960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784450.868931:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784450.869017:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643096960 00000100:00100000:2.0:1787784450.869039:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643096960 00000100:00100000:2.0:1787784450.869113:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787784450.869127:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643096960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784450.869184:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784450.869236:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643096960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784450.869244:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787784450.869268:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784450.869308:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9d680 x1874627643096960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784450.869328:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643096960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787784451.708565:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784452.411633:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643097216:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.411634:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643097088:0@lo:400:kworker.0 00000100:00100000:0.0:1787784452.411969:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097472:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.418080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784452.418166:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643097600:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.418212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784452.418281:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097600 00000100:00100000:2.0:1787784452.418291:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097088 00000100:00100000:3.0:1787784452.418292:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097600 00000100:00100000:2.0:1787784452.418294:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097088 00000100:00100000:3.0:1787784452.418347:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787784452.418347:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787784452.418356:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643097600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.418356:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643097088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.418435:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643097088:12345-0@lo:400:kworker.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784452.418439:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643097600:12345-0@lo:400:kworker.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784452.418442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787784452.418446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787784452.418478:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784452.418522:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643097088:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.418536:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643097600:0@lo:400:kworker.0 00000100:00100000:1.0:1787784452.422361:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784452.422446:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643097728:0@lo:400:kworker.0 00000100:00100000:1.0:1787784452.422496:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784452.428250:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643097344:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.428355:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784452.428458:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097216 00000100:00100000:2.0:1787784452.428468:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097216 00000100:00100000:2.0:1787784452.428522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097344 00000100:00100000:2.0:1787784452.428540:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097344 00000100:00100000:2.0:1787784452.428577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784452.428587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643097216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784452.428774:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787784452.428786:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643097344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784452.428836:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197016940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643097344:12345-0@lo:400:kworker.0 Request processed in 54us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784452.428844:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787784452.429292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787784452.429381:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784452.429402:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097728 00000100:00100000:0.0:1787784452.429407:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097728 00000100:00100000:0.0:1787784452.429447:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097472 00000100:00100000:0.0:1787784452.429449:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097472 00000100:00100000:0.0:1787784452.429470:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784452.429479:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643097728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784452.429517:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643097728:12345-0@lo:400:kworker.0 Request processed in 40us (7021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784452.429523:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787784452.429538:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784452.429554:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784452.429590:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097472:12345-0@lo:400:kworker.0 Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784452.429595:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787784452.429615:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784452.429618:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784452.429649:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbe1c0 x1874627643097472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784452.429667:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097472:0@lo:400:kworker.0 00000100:00100000:0.0:1787784452.429943:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643097216:0@lo:400:kworker.0 00010000:00080000:0.0:1787784452.429958:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbd2c0 x1874627643097728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784452.429968:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643097728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784452.430302:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643097216:12345-0@lo:400:kworker.0 Request processed in 66us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784452.430313:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784452.430353:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643097344:0@lo:400:kworker.0 00010000:00010000:1.0:1787784452.734868:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784452.921626:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784452.921659:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784452.921848:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784452.921948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097856 00000100:00100000:2.0:1787784452.921958:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097856 00000100:00100000:2.0:1787784452.922205:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784452.922216:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784452.922269:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784452.922325:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784452.922335:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787784452.922417:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9a9d680 x1874627643097856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784452.922441:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787784453.748560:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784453.893706:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784453.893766:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784453.893816:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784453.893846:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784453.893879:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784453.893921:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673408 00000100:00100000:0.0:1787784453.893932:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673408 00000100:00100000:0.0:1787784453.894002:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673280 00000100:00100000:0.0:1787784453.894007:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673280 00000100:00100000:0.0:1787784453.894036:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:0.0:1787784453.894047:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673408:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784453.894133:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673408:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784453.894156:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:0.0:1787784453.894177:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784453.894185:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673280:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784453.894222:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673280:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784453.894229:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784453.894253:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673152 00000100:00100000:0.0:1787784453.894257:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673152 00000100:00100000:1.0:1787784453.894409:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634672896 00000100:00100000:1.0:1787784453.894415:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634672896 00000100:00100000:1.0:1787784453.894449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:1.0:1787784453.894457:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634672896:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784453.894486:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634672896:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784453.894493:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:0.0:1787784453.894954:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673024 00000100:00100000:0.0:1787784453.894960:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673024 00000100:00100000:0.0:1787784453.895103:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1787784453.895112:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673152:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784453.895152:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634673152:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 42us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784453.895159:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1787784453.895173:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:0.0:1787784453.895179:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634673024:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784453.895204:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634673024:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784453.895210:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00080000:1.0:1787784453.901486:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784453.901499:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787784453.901502:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787784454.775014:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784455.796808:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784455.991891:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784455.991976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784455.992068:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643097984 00000100:00100000:1.0:1787784455.992076:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643097984 00000100:00100000:1.0:1787784455.992133:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784455.992144:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784455.992197:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784455.992259:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643097984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784455.992267:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787784455.992291:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784455.992328:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbc780 x1874627643097984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784455.992501:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643097984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784456.826866:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784457.530432:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643098240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784457.530671:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643098112:0@lo:400:kworker.0 00000100:00100000:3.0:1787784457.530718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784457.531171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784457.537856:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643098624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784457.544496:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098112 00000100:00100000:2.0:1787784457.544804:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098112 00000100:00100000:0.0:1787784457.547788:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643098752:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.547899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784457.547958:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643098368:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.548008:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784457.548596:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784457.548608:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643098496:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.548657:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784457.548707:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098752 00000100:00100000:0.0:1787784457.548716:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098752 00000100:00100000:0.0:1787784457.548796:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098496 00000100:00100000:0.0:1787784457.548800:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098496 00000100:00100000:0.0:1787784457.548876:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784457.548886:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643098752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.548961:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643098752:12345-0@lo:400:kworker.0 Request processed in 77us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784457.548970:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784457.548992:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784457.548998:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.550398:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643098496:12345-0@lo:400:kworker.0 Request processed in 1390us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784457.550410:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784457.550454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098240 00000100:00100000:0.0:1787784457.550462:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098240 00000100:00100000:0.0:1787784457.550509:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098368 00000100:00100000:0.0:1787784457.550513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098368 00000100:00100000:0.0:1787784457.550678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787784457.550688:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643098240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.550750:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643098240:12345-0@lo:400:kworker.0 Request processed in 65us (19581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784457.550770:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787784457.550784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784457.550789:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643098368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.550820:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643098368:12345-0@lo:400:kworker.0 Request processed in 31us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784457.550825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1787784457.550846:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784457.550851:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784457.550854:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787784457.550905:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba23de00 x1874627643098496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784457.550920:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643098496:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.550935:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643098368:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.550987:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784457.551410:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787784457.551425:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.551459:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098624 00000100:00100000:0.0:1787784457.551465:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098624 00000100:00100000:2.0:1787784457.551480:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643098112:12345-0@lo:400:kworker.0 Request processed in 61us (20763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784457.551487:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787784457.551499:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787784457.551505:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.552104:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643098624:12345-0@lo:400:kworker.0 Request processed in 596us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784457.552114:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787784457.552134:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784457.552167:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643098112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784457.552181:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643098624:0@lo:400:kworker.0 00000100:00100000:2.0:1787784457.552255:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643098240:0@lo:400:kworker.0 00010000:00080000:2.0:1787784457.552279:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba23f0c0 x1874627643098752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784457.552291:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643098752:0@lo:400:kworker.0 00010000:00010000:3.0:1787784457.845645:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784458.038129:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784458.038161:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643098880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784458.038254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784458.041131:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643098880 00000100:00100000:1.0:1787784458.041151:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643098880 00000100:00100000:1.0:1787784458.043076:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787784458.043097:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643098880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784458.043156:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784458.043768:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643098880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 671us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784458.043783:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787784458.052501:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a43c0 x1874627643098880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784458.053675:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643098880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787784458.868516:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784459.000735:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784459.000845:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784459.000929:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784459.000952:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784459.000978:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784459.001019:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673536 00000100:00100000:3.0:1787784459.001031:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673536 00000100:00100000:3.0:1787784459.001101:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:3.0:1787784459.001111:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634673536:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784459.001199:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634673536:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 90us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784459.001208:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:1.0:1787784459.003530:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673920 00000100:00100000:1.0:1787784459.003541:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673920 00000100:00100000:1.0:1787784459.003596:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674048 00000100:00100000:1.0:1787784459.003599:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674048 00000100:00100000:1.0:1787784459.003621:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1787784459.003642:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2361:x1874627634673920:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:1.0:1787784459.003668:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20baa53 00000100:00080000:1.0:1787784459.003675:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9431b3c6b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784459.003711:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787784459.004146:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+2:2361:x1874627634673920:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 504us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784459.004153:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1787784459.004168:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:1.0:1787784459.004184:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2361:x1874627634674048:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:1.0:1787784459.004196:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20baa5a 00000100:00080000:1.0:1787784459.004201:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9431bee7a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787784459.004220:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787784459.004665:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+2:2361:x1874627634674048:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 490us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784459.004673:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:1.0:1787784459.004696:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784459.004702:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784459.005757:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673792 00000100:00100000:0.0:1787784459.005765:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673792 00000100:00100000:0.0:1787784459.005908:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634673664 00000100:00100000:0.0:1787784459.005912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634673664 00000100:00100000:3.0:1787784459.005953:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:3.0:1787784459.005964:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634673792:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784459.006031:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634673792:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 69us (5185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784459.006039:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:3.0:1787784459.006057:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:3.0:1787784459.006064:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634673664:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784459.006157:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634673664:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 93us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784459.006164:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00080000:0.0:1787784459.008025:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784459.008034:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784459.008037:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784459.894460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784460.916635:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784461.108727:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784461.108756:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643099008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784461.108836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784461.108918:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099008 00000100:00100000:0.0:1787784461.108925:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099008 00000100:00100000:0.0:1787784461.108973:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784461.108981:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643099008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784461.109018:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784461.109061:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643099008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784461.109068:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787784461.109087:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784461.109826:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba23de00 x1874627643099008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784461.109952:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643099008:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787784461.243494:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000020:00000080:1.0:1787784461.243503:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431bee79800/2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000020:00000080:2.0:1787784461.243591:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee79800/2dcd91ed-fe78-44b1-8596-d4df1b711f35 for lustre-OST0001 00000020:00000080:2.0:1787784461.243646:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bee7a000 for lustre-OST0001 00010000:00010000:0.0:1787784461.940551:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784462.669071:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784462.669092:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643099136:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.669666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784462.669782:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099136 00000100:00100000:2.0:1787784462.669801:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099136 00000100:00100000:2.0:1787784462.670246:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787784462.670260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643099136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.670317:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643099136:12345-0@lo:400:kworker.0 Request processed in 62us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784462.670324:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787784462.670387:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643099136:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.670434:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643099264:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.670460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784462.670525:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784462.670531:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643099648:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.670553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784462.672664:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784462.672687:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643099776:0@lo:400:kworker.0 00000100:00100000:0.0:1787784462.672755:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784462.672807:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099264 00000100:00100000:0.0:1787784462.672814:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099264 00000100:00100000:0.0:1787784462.673001:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099648 00000100:00100000:0.0:1787784462.673005:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099648 00000100:00100000:0.0:1787784462.673036:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784462.673044:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.673204:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643099520:0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.673233:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784462.673254:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784462.673261:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943196293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643099392:0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.673285:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784462.673312:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099776 00000100:00100000:1.0:1787784462.673316:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099776 00000100:00100000:1.0:1787784462.673344:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099520 00000100:00100000:1.0:1787784462.673348:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099520 00000100:00100000:1.0:1787784462.673381:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784462.673395:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643099776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.673428:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643099776:12345-0@lo:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784462.673434:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784462.673455:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784462.673461:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.673492:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643099520:12345-0@lo:400:kworker.0 Request processed in 31us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784462.673498:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787784462.673516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099392 00000100:00100000:1.0:1787784462.673519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099392 00000100:00100000:1.0:1787784462.673536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787784462.673543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643099648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784462.673644:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787784462.673654:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784462.673697:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643099392:12345-0@lo:400:kworker.0 Request processed in 45us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784462.673703:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787784462.685974:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643099264:12345-0@lo:400:kworker.0 Request processed in 12920us (15502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784462.685990:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787784462.686077:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784462.686084:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784462.686131:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943186e0d2c0 x1874627643099776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784462.686157:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643099776:0@lo:400:kworker.0 00000100:00100000:1.0:1787784462.689712:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643099648:12345-0@lo:400:kworker.0 Request processed in 16159us (19147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784462.689728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787784462.689799:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643099392:0@lo:400:kworker.0 00010000:00080000:1.0:1787784462.689815:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943196293480 x1874627643099520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784462.689827:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643099520:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.696416:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643099264:0@lo:400:kworker.0 00000100:00100000:2.0:1787784462.696468:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943196290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643099648:0@lo:400:kworker.0 00010000:00010000:1.0:1787784462.974621:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784463.157071:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643099904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784463.157148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784463.157230:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643099904 00000100:00100000:3.0:1787784463.157238:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643099904 00000100:00100000:3.0:1787784463.157285:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787784463.157294:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643099904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784463.157333:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784463.157399:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643099904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784463.157407:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787784463.157448:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9680 x1874627643099904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784463.157468:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643099904:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787784463.821095:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000020:00000080:1.0:1787784463.821103:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431b3c6e000/2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000020:00000080:0.0:1787784463.830285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b3c6e000/2dcd91ed-fe78-44b1-8596-d4df1b711f35 for lustre-OST0000 00000020:00000080:0.0:1787784463.838819:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b3c6b000 for lustre-OST0000 00010000:00010000:0.0:1787784463.992964:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784464.122477:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784464.122517:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784464.122556:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784464.122650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674304 00000100:00100000:0.0:1787784464.122658:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674304 00000100:00100000:0.0:1787784464.122718:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674432 00000100:00100000:0.0:1787784464.122721:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674432 00000100:00100000:0.0:1787784464.122741:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1787784464.122749:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634674304:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784464.122824:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634674304:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784464.122831:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1787784464.122865:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:0.0:1787784464.122872:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634674432:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784464.122899:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634674432:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784464.122905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:2.0:1787784464.123141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674176 00000100:00100000:2.0:1787784464.123146:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674176 00000100:00100000:2.0:1787784464.123186:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:2.0:1787784464.123194:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634674176:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784464.123223:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634674176:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784464.123229:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00080000:0.0:1787784464.124265:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784465.017406:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784465.134505:0:11012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787784466.036586:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784466.229504:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643100032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784466.229589:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784466.229781:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100032 00000100:00100000:3.0:1787784466.229788:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100032 00000100:00100000:3.0:1787784466.229848:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784466.229856:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643100032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784466.229887:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784466.229931:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643100032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784466.229938:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787784466.229976:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9680 x1874627643100032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784466.230001:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643100032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784466.230064:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784467.061585:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784467.765890:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643100160:0@lo:400:kworker.0 00000100:00100000:0.0:1787784467.765961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784467.766046:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100160 00000100:00100000:1.0:1787784467.766054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100160 00000100:00100000:1.0:1787784467.766114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787784467.766123:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643100160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784467.768977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643100160:12345-0@lo:400:kworker.0 Request processed in 2850us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784467.768991:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787784467.770945:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643100288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771016:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.771044:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643100800:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771067:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.771087:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784467.771092:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643100672:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.771130:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643100544:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.771163:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784467.771167:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643100416:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771183:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784467.771207:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100288 00000100:00100000:3.0:1787784467.771213:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100288 00000100:00100000:3.0:1787784467.771249:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100672 00000100:00100000:3.0:1787784467.771251:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100672 00000100:00100000:3.0:1787784467.771272:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100416 00000100:00100000:3.0:1787784467.771274:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100416 00000100:00100000:3.0:1787784467.771289:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787784467.771296:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643100288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771340:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643100288:12345-0@lo:400:kworker.0 Request processed in 43us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784467.771347:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787784467.771361:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787784467.771402:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643100672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771429:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643100672:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784467.771434:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787784467.771445:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784467.771451:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643100416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771474:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643100416:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784467.771480:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784467.771510:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643100672:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771520:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643100288:0@lo:400:kworker.0 00000100:00100000:3.0:1787784467.771555:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643100416:0@lo:400:kworker.0 00000100:00100000:1.0:1787784467.771734:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100800 00000100:00100000:1.0:1787784467.771738:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100800 00000100:00100000:1.0:1787784467.771769:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100544 00000100:00100000:1.0:1787784467.771771:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100544 00000100:00100000:1.0:1787784467.771788:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784467.771794:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643100800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784467.771830:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643100800:12345-0@lo:400:kworker.0 Request processed in 37us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784467.771836:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784467.771846:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784467.771852:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643100544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784467.771877:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643100544:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784467.771883:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787784467.771899:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784467.771902:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787784467.771922:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fb8f00 x1874627643100800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784467.771933:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643100800:0@lo:400:kworker.0 00010000:00080000:1.0:1787784467.771962:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a43c0 x1874627643100544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784467.771971:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643100544:0@lo:400:kworker.0 00000100:00100000:0.0:1787784467.773473:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643100160:0@lo:400:kworker.0 00010000:00010000:0.0:1787784468.106650:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784468.284685:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643100928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784468.284771:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784468.292610:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643100928 00000100:00100000:3.0:1787784468.292629:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643100928 00000100:00100000:3.0:1787784468.292782:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784468.292793:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643100928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784468.292837:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784468.292969:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643100928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (8197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784468.292976:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787784468.293163:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf69bc00 x1874627643100928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784468.293184:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643100928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784469.112013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784469.241738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784469.241771:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784469.241805:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784469.241835:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674816 00000100:00100000:1.0:1787784469.241845:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674816 00000100:00100000:1.0:1787784469.241897:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674688 00000100:00100000:1.0:1787784469.241900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674688 00000100:00100000:1.0:1787784469.241920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1787784469.241928:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634674816:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784469.242003:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634674816:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784469.242012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1787784469.242027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:1.0:1787784469.242033:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634674688:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784469.242057:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634674688:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784469.242062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00080000:1.0:1787784469.242078:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784469.246774:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674560 00000100:00100000:3.0:1787784469.246800:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674560 00000100:00100000:3.0:1787784469.246922:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 235 00000100:00100000:3.0:1787784469.246933:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634674560:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784469.247015:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634674560:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 84us (5287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784469.247024:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 235 00000020:00000080:2.0:1787784469.332638:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2048e5d0 20000000:00000080:2.0:1787784469.332662:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431bf656400 uarg=0000000000000000 20000000:01000000:2.0:1787784469.332705:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787784469.332711:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787784469.332726:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787784469.336990:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787784469.346071:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787784469.357338:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784469.360671:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360703:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360713:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360720:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360727:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360734:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360742:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360789:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360823:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.360838:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101056:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784469.360949:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.360958:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 18 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.360967:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101184:0@lo:104: 00000100:00100000:3.0:1787784469.361010:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784469.361058:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101184 00000100:00100000:3.0:1787784469.361065:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101184 00000100:00100000:3.0:1787784469.361131:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787784469.361141:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:11160:x1874627643101184:12345-0@lo:104: 00010000:00010000:3.0:1787784469.361153:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361200:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784469.361206:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:11160:x1874627643101184:12345-0@lo:104: Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784469.361213:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1787784469.361248:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361255:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 18 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.361270:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101312:0@lo:104: 00000100:00100000:3.0:1787784469.361292:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784469.361314:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361321:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 18 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.361329:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101440:0@lo:104: 00000100:00100000:3.0:1787784469.361349:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784469.361395:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101312 00000100:00100000:3.0:1787784469.361399:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101312 00000100:00100000:3.0:1787784469.361440:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101440 00000100:00100000:3.0:1787784469.361443:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101440 00000100:00100000:3.0:1787784469.361458:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784469.361464:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11160:x1874627643101312:12345-0@lo:104: 00010000:00010000:3.0:1787784469.361472:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361503:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784469.361508:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11160:x1874627643101312:12345-0@lo:104: Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784469.361514:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784469.361527:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784469.361544:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:11160:x1874627643101440:12345-0@lo:104: 00010000:00010000:3.0:1787784469.361552:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361590:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787784469.361595:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+3:11160:x1874627643101440:12345-0@lo:104: Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784469.361602:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787784469.361636:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.361645:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 12 pid: 5825 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.361652:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101568:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784469.361681:0:11160:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784469.361701:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101184:0@lo:104: 00000100:00100000:3.0:1787784469.361709:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101312:0@lo:104: 00000100:00100000:3.0:1787784469.361714:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101440:0@lo:104: 00010000:00010000:0.0:1787784469.364720:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787784469.364735:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364749:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611200 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784469.364755:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364765:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784469.364772:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784469.364797:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784469.364843:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364850:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784469.364876:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364885:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185611200/0xffb8d925c20baa29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa30 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364898:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784469.364902:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364909:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611e00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784469.364912:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364919:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784469.364926:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784469.364933:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784469.364946:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364952:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784469.364973:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364980:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185611e00/0xffb8d925c20baa1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364990:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784469.364993:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.364999:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784469.365002:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365009:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784469.365015:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784469.365021:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784469.365033:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365039:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784469.365044:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365050:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d1000/0xffb8d925c20baa0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa14 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365079:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784469.365086:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784469.365088:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784469.365096:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784469.365115:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643101696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784469.365181:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784469.365245:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643101824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784469.365269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784469.365288:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784469.365294:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643101952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784469.365314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784469.365345:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101696 00000100:00100000:0.0:1787784469.365352:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101696 00010000:00010000:0.0:1787784469.365399:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784469.365437:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101824 00000100:00100000:0.0:1787784469.365441:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101824 00010000:00010000:0.0:1787784469.365455:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 20 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784469.365465:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643101952 00000100:00100000:0.0:1787784469.365468:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643101952 00010000:00010000:0.0:1787784469.365478:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 21 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784469.365492:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784469.365500:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3294:x1874627643101696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784469.365512:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784469.365519:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 21 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365547:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 21 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365564:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610a00/0xffb8d925c20baa30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa29 expref: 21 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365580:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784469.365620:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3294:x1874627643101696:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784469.365627:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784469.365680:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784469.365686:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643101824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784469.365693:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784469.365698:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 19 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365705:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 19 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365714:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1a00/0xffb8d925c20baa22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa1b expref: 19 pid: 5823 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365722:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784469.365748:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3295:x1874627643101824:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784469.365753:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784469.365766:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784469.365773:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3295:x1874627643101952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784469.365787:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784469.365792:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 17 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365801:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 17 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365810:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031800/0xffb8d925c20baa14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa0d expref: 17 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.365819:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784469.365843:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3295:x1874627643101952:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784469.365849:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784469.365892:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643101952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784469.365901:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643101824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784469.365930:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643101696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784469.367746:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6983c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101056:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784469.367760:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1874627643101568:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784469.367795:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784469.369904:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784469.369984:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784469.381171:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675072 00000100:00100000:0.0:1787784469.381188:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675072 00010000:00010000:0.0:1787784469.381243:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 13 pid: 5825 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784469.381292:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634674944 00000100:00100000:0.0:1787784469.381296:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634674944 00010000:00010000:0.0:1787784469.381308:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 14 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784469.381358:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:2.0:1787784469.381395:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+14:2362:x1874627634675072:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784469.381422:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784469.381429:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 14 pid: 5825 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784469.381440:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 14 pid: 5825 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784469.381458:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030c00/0xffb8d925c20baa06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8b7 expref: 14 pid: 5825 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784469.381472:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784469.381547:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634675072:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 156us (11649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784469.381554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:0.0:1787784469.382140:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:0.0:1787784469.382165:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2363:x1874627634674944:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784469.382176:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784469.382182:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382193:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382205:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1400/0xffb8d925c20baa45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a8ef expref: 12 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382218:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382227:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382241:0:8443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382248:0:8443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382254:0:8443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382260:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382266:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784469.382270:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382283:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382303:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784469.382323:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784469.382379:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:2363:x1874627634674944:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 202us (12381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784469.382387:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00010000:00010000:3.0:1787784469.382409:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.382430:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784469.382444:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610800/0xffb8d925c20baa61 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784470.133213:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784470.710860:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784470.710869:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431bf2b0000 from 7 10000000:01000000:3.0:1787784470.710875:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784470.710929:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784470.710941:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784470.710953:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784470.710996:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.711106:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784470.711182:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.711812:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102080 00000100:00100000:1.0:1787784470.711822:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102080 00000100:00100000:1.0:1787784470.711899:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787784470.711908:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643102080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784470.711921:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784470.711936:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa68 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.711962:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.711973:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.711983:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784470.712042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.712049:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787784470.712918:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784470.712939:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.712950:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784470.713025:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784470.713095:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784470.713145:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2c6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.713199:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102208 00000100:00100000:1.0:1787784470.713205:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102208 00000100:00100000:1.0:1787784470.713245:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787784470.713253:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784470.713579:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.713586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787784470.713736:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.713768:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.713813:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784470.713847:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787784470.714000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102336 00000100:00100000:0.0:1787784470.714006:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102336 00000100:00100000:0.0:1787784470.714058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787784470.714073:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784470.714240:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784470.714247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787784470.714553:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784470.717141:0:11174:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787784470.717503:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787784470.717542:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784470.717554:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.717566:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784470.717578:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784470.717581:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9ffe000 from 7 10000000:01000000:2.0:1787784470.717584:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784470.717633:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.717642:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.717653:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784470.717679:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784470.717756:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784470.717803:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.717918:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102464 00000100:00100000:1.0:1787784470.717925:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102464 00000100:00100000:1.0:1787784470.717971:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787784470.717980:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643102464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784470.717991:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784470.718015:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa76 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.718041:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.718053:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.718061:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0600, rc 0) 00000100:00100000:1.0:1787784470.718111:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.718118:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787784470.718479:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784470.718493:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.718502:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784470.718575:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784470.718603:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784470.718638:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.720627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102592 00000100:00100000:1.0:1787784470.720641:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102592 00000100:00100000:1.0:1787784470.720714:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787784470.720725:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784470.721029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.721036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787784470.726381:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.726468:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.726584:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784470.726643:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.727039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102720 00000100:00100000:1.0:1787784470.727046:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102720 00000100:00100000:1.0:1787784470.727100:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787784470.727110:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784470.727582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 472us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.727590:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787784470.728081:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784470.729558:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787784470.730029:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787784470.730054:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784470.730066:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.730078:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784470.730090:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784470.730092:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94318875c800 from 7 10000000:01000000:2.0:1787784470.730096:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784470.730136:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.730145:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784470.730167:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784470.730197:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784470.730270:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784470.730309:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf2c6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.732107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102848 00000100:00100000:1.0:1787784470.732137:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102848 00000100:00100000:1.0:1787784470.732221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787784470.732232:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643102848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784470.732249:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784470.732267:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20baa84 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.732296:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.732307:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784470.732315:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784470.732429:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643102848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.732436:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787784470.732877:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784470.732897:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784470.732906:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784470.732972:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.733006:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784470.733030:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784470.733149:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643102976 00000100:00100000:2.0:1787784470.733166:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643102976 00000100:00100000:2.0:1787784470.733252:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787784470.733262:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643102976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784470.733946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643102976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 684us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784470.733953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787784470.734028:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643102976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.734063:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643103104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784470.734103:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784470.734135:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784470.734441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103104 00000100:00100000:1.0:1787784470.734446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103104 00000100:00100000:1.0:1787784470.734477:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787784470.734484:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643103104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784470.734835:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643103104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784470.734842:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787784470.734935:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643103104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787784470.746436:0:11176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787784470.746850:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787784470.746872:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784470.746885:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784470.746897:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784471.158900:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784471.348793:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784471.348818:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643103232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784471.348896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784471.348964:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103232 00000100:00100000:1.0:1787784471.348985:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103232 00000100:00100000:1.0:1787784471.349044:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787784471.349053:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643103232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784471.349101:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784471.349149:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643103232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784471.349156:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787784471.349177:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784471.349209:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbc3c0 x1874627643103232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784471.349229:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643103232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784471.352486:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784471.352720:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675200 00000100:00100000:3.0:1787784471.352730:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675200 00000100:00100000:3.0:1787784471.352799:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 245 00000100:00100000:3.0:1787784471.352809:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:5609:x1874627634675200:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784471.352826:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784471.352847:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a919 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.352877:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.352889:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.352898:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611000, rc 0) 00000100:00100000:3.0:1787784471.352957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675200:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 150us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784471.352965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 245 00000100:00100000:1.0:1787784471.355666:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784471.355737:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675328 00000100:00100000:3.0:1787784471.355746:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675328 00000100:00100000:3.0:1787784471.355912:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 246 00000100:00100000:3.0:1787784471.355922:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675328:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784471.356297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675328:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 375us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784471.356306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 246 00000100:00100000:3.0:1787784471.367528:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784471.369628:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675456 00000100:00100000:2.0:1787784471.369646:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675456 00000100:00100000:2.0:1787784471.369715:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 247 00000100:00100000:2.0:1787784471.369727:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675456:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784471.369975:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675456:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 251us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784471.369982:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 247 00000100:00100000:2.0:1787784471.385077:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784471.385275:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675584 00000100:00100000:3.0:1787784471.385286:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675584 00000100:00100000:3.0:1787784471.385390:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 248 00000100:00100000:3.0:1787784471.385400:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634675584:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784471.385416:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784471.385434:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a920 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.385462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.385473:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784471.385483:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611400, rc 0) 00000100:00100000:3.0:1787784471.385551:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634675584:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 153us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784471.385558:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 248 00000100:00100000:2.0:1787784471.392259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784471.392306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675712 00000100:00100000:2.0:1787784471.392317:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675712 00000100:00100000:2.0:1787784471.392390:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 249 00000100:00100000:2.0:1787784471.392402:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634675712:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784471.392743:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634675712:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 342us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784471.392751:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 249 00000100:00100000:0.0:1787784471.409661:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784471.409738:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675840 00000100:00100000:2.0:1787784471.409749:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675840 00000100:00100000:2.0:1787784471.409822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 250 00000100:00100000:2.0:1787784471.409832:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634675840:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784471.410079:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634675840:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 247us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784471.410087:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 250 00010000:00010000:0.0:1787784472.180597:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784472.887990:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643103744:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888082:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888151:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784472.888158:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643103360:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888189:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888210:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643103872:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888234:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888261:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643103488:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888298:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643104000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888350:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784472.888356:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643103616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784472.888460:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103744 00000100:00100000:1.0:1787784472.888468:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103744 00000100:00100000:1.0:1787784472.888524:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104000 00000100:00100000:1.0:1787784472.888528:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104000 00000100:00100000:1.0:1787784472.888558:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784472.888567:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643103744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888616:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643103744:12345-0@lo:400:kworker.0 Request processed in 49us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784472.888623:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784472.888652:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784472.888659:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643104000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888690:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643104000:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784472.888696:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784472.888714:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103872 00000100:00100000:1.0:1787784472.888718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103872 00000100:00100000:1.0:1787784472.888741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103488 00000100:00100000:1.0:1787784472.888744:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103488 00000100:00100000:1.0:1787784472.888769:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103616 00000100:00100000:1.0:1787784472.888772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103616 00000100:00100000:1.0:1787784472.888789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787784472.888795:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643103872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888827:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643103872:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784472.888833:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787784472.888844:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787784472.888849:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643103488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643103488:12345-0@lo:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784472.888892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787784472.888902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784472.888908:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643103616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.888931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643103616:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784472.888937:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787784472.888977:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784472.888981:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784472.889014:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643103616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.889025:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643103488:0@lo:400:kworker.0 00010000:00080000:1.0:1787784472.889037:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbc000 x1874627643104000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784472.889047:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643104000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784472.889079:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643103872:0@lo:400:kworker.0 00010000:00080000:1.0:1787784472.889087:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbe580 x1874627643103744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784472.889096:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643103744:0@lo:400:kworker.0 00000100:00100000:2.0:1787784472.889288:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643103360 00000100:00100000:2.0:1787784472.889293:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643103360 00000100:00100000:2.0:1787784472.889329:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787784472.889337:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784472.889396:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643103360:12345-0@lo:400:kworker.0 Request processed in 61us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784472.889403:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787784472.891998:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643103360:0@lo:400:kworker.0 00010000:00010000:0.0:1787784473.215227:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784473.400255:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643104128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784473.400334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784473.400521:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104128 00000100:00100000:0.0:1787784473.400530:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104128 00000100:00100000:0.0:1787784473.400598:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787784473.400615:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643104128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784473.400662:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784473.411273:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643104128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10639us (10919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784473.411290:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787784473.419579:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419b0c0 x1874627643104128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784473.419630:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643104128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784474.232937:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784474.362777:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784474.362821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784474.362850:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784474.362893:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634675968 00000100:00100000:0.0:1787784474.362904:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634675968 00000100:00100000:0.0:1787784474.362957:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 252 00000100:00100000:0.0:1787784474.362967:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634675968:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784474.363050:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634675968:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.363057:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 252 00000100:00100000:0.0:1787784474.363092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676096 00000100:00100000:0.0:1787784474.363096:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676096 00000100:00100000:0.0:1787784474.363134:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676224 00000100:00100000:0.0:1787784474.363138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676224 00000100:00100000:0.0:1787784474.363161:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:0.0:1787784474.363168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634676096:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784474.363202:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634676096:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.363210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:0.0:1787784474.363222:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:0.0:1787784474.363245:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634676224:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784474.363274:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634676224:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784474.363281:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00080000:0.0:1787784474.363425:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787784474.653322:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787784475.252601:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784476.282567:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784476.469060:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643104256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784476.469148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784476.469223:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104256 00000100:00100000:1.0:1787784476.469231:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104256 00000100:00100000:1.0:1787784476.469293:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784476.469303:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643104256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784476.469338:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784476.469405:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643104256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784476.469412:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787784476.469584:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787784476.469622:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9430833b4780 x1874627643104256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784476.469642:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643104256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787784477.302254:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784478.005031:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643104384:0@lo:400:kworker.0 00000100:00100000:3.0:1787784478.005114:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784478.005235:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104384 00000100:00100000:2.0:1787784478.005244:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104384 00000100:00100000:2.0:1787784478.005565:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787784478.005577:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.008616:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643104512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.008716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784478.008771:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784478.008778:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643104640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.008801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784478.008834:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104512 00000100:00100000:0.0:1787784478.008841:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104512 00000100:00100000:0.0:1787784478.009072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104640 00000100:00100000:0.0:1787784478.009077:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104640 00000100:00100000:0.0:1787784478.009115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784478.009124:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643104512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643104512:12345-0@lo:400:kworker.0 Request processed in 58us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784478.009190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787784478.009210:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787784478.009216:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643104640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643104640:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784478.009249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787784478.009288:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784478.009328:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643104640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009340:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643104512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009422:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643104768:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784478.009509:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104768 00000100:00100000:0.0:1787784478.009514:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104768 00000100:00100000:0.0:1787784478.009548:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787784478.009555:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.009592:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643104768:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784478.009598:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787784478.009613:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787784478.009630:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9430833b4b40 x1874627643104768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784478.009640:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643104768:0@lo:400:kworker.0 00000100:00100000:2.0:1787784478.009852:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643104384:12345-0@lo:400:kworker.0 Request processed in 4275us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784478.010116:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787784478.013205:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643105024:0@lo:400:kworker.0 00000100:00100000:2.0:1787784478.013301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784478.013899:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105024 00000100:00100000:1.0:1787784478.013908:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105024 00000100:00100000:1.0:1787784478.013978:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787784478.013988:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643105024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787784478.014097:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784478.014417:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643105024:12345-0@lo:400:kworker.0 Request processed in 428us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784478.014426:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787784478.014543:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9430833b4f00 x1874627643105024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784478.014560:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643105024:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.015123:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784478.015140:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9430833b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643104896:0@lo:400:kworker.0 00000100:00100000:0.0:1787784478.015185:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784478.015795:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643104896 00000100:00100000:1.0:1787784478.015804:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643104896 00000100:00100000:1.0:1787784478.016058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787784478.016068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784478.016128:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643104896:12345-0@lo:400:kworker.0 Request processed in 62us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784478.016135:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787784478.016826:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643104896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784478.017315:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9430833b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643104384:0@lo:400:kworker.0 00000100:00080000:2.0:1787784478.020108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784478.324944:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784478.518277:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784478.518303:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643105152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784478.518402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784478.518597:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105152 00000100:00100000:1.0:1787784478.518606:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105152 00000100:00100000:1.0:1787784478.518657:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787784478.518666:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643105152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784478.518715:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784478.518770:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643105152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784478.518777:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787784478.518914:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac6940 x1874627643105152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784478.518936:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643105152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784479.348920:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784479.493654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784479.493771:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784479.493808:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784479.493873:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676608 00000100:00100000:3.0:1787784479.493882:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676608 00000100:00100000:3.0:1787784479.493952:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676480 00000100:00100000:3.0:1787784479.493956:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676480 00000100:00080000:1.0:1787784479.494055:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784479.494104:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:3.0:1787784479.494116:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634676608:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784479.494275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:1.0:1787784479.494285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634676480:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784479.494325:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634676480:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 42us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784479.494332:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:3.0:1787784479.494601:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634676608:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 487us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784479.494608:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:0.0:1787784479.494870:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676352 00000100:00100000:0.0:1787784479.494875:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676352 00000100:00100000:0.0:1787784479.494914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 254 00000100:00100000:0.0:1787784479.494922:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634676352:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784479.495278:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634676352:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 355us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784479.495286:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 254 00000001:02000400:3.0:1787784479.823667:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:47:57 (1787784477) === 00000100:00100000:1.0:1787784480.167934:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784480.168014:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.168159:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676736 00000100:00100000:0.0:1787784480.168170:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676736 00000100:00100000:0.0:1787784480.168235:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1787784480.168246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634676736:12345-192.168.202.59@tcp:41:mkdir.0 00000004:00000024:0.0:1787784480.168294:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784480.168430:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634676736:12345-192.168.202.59@tcp:41:mkdir.0 Request processed in 186us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.168449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784480.168910:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634676864 00000100:00100000:2.0:1787784480.168916:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634676864 00000100:00100000:2.0:1787784480.168955:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784480.168964:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:9713:x1874627634676864:12345-192.168.202.59@tcp:700:mkdir.0 00000100:00100000:2.0:1787784480.169031:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:9713:x1874627634676864:12345-192.168.202.59@tcp:700:mkdir.0 Request processed in 68us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784480.169039:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784480.180603:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.180697:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634677120 00000100:00100000:3.0:1787784480.180709:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634677120 00000100:00100000:3.0:1787784480.180765:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784480.180776:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:9713:x1874627634677120:12345-192.168.202.59@tcp:36:mkdir.0 00010000:00010000:3.0:1787784480.180840:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784480.180910:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20ba981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a2 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.180931:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784480.180941:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784480.181302:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.181315:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.181326:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.181351:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.181358:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.181416:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784480.182755:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787784480.182772:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182781:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182789:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182795:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.182800:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182807:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182824:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94319746ee00) 00010000:00010000:3.0:1787784480.182828:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.182833:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.182850:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baaa0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784480.182869:0:8618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f851afc reply state 000000001ef84455 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.182878:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784480.182985:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9713:x1874627634677120:12345-192.168.202.59@tcp:36:mkdir.0 Request processed in 2206us (2387us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787784480.182993:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:2.0:1787784480.195586:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195606:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195615:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195622:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784480.195627:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195637:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195677:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94319746ec00) 00010000:00010000:2.0:1787784480.195681:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784480.195685:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.195693:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baaa7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784480.200475:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.200639:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634677248 00000100:00100000:0.0:1787784480.200649:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634677248 00000100:00100000:0.0:1787784480.200717:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784480.200727:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:9715:x1874627634677248:12345-192.168.202.59@tcp:101:chmod.0 00010000:00010000:0.0:1787784480.200750:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784480.200775:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a927 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.200838:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.200851:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.200863:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784480.200944:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787784480.200948:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784480.200992:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.201020:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a927 expref: 8 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.201038:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a927 expref: 7 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.201047:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.201050:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784480.201053:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030400, rc 0) 00000100:00100000:0.0:1787784480.201116:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9715:x1874627634677248:12345-192.168.202.59@tcp:101:chmod.0 Request processed in 391us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.201125:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784480.203713:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.203826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634677504 00000100:00100000:0.0:1787784480.203835:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634677504 00000100:00100000:0.0:1787784480.203892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:0.0:1787784480.203901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9715:x1874627634677504:12345-192.168.202.59@tcp:36:chmod.0 00010000:00010000:0.0:1787784480.203955:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784480.203981:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a927 expref: 7 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.204011:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.204022:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784480.204059:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.204072:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.204082:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784480.204883:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a652cee reply state 0000000004025378 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784480.204895:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787784480.204914:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787784480.205866:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:9715:x1874627634677504:12345-192.168.202.59@tcp:36:chmod.0 Request processed in 1960us (2155us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787784480.205877:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00010000:00010000:1.0:1787784480.221890:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.221907:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.221934:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.221941:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180031800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784480.221946:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.221955:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.221974:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc800) 00010000:00010000:1.0:1787784480.221978:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784480.221983:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.222000:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baabc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784480.262141:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.262252:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634677632 00000100:00100000:0.0:1787784480.262262:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634677632 00000100:00100000:0.0:1787784480.262330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:0.0:1787784480.262340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9716:x1874627634677632:12345-192.168.202.59@tcp:101:chown.0 00010000:00010000:0.0:1787784480.262401:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784480.262426:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a92e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262505:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262520:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262547:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784480.262625:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787784480.262630:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784480.262678:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262716:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180030400/0xffb8d925c20baac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a92e expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262737:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a92e expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.262744:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.262747:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784480.262751:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943180030c00, rc 0) 00000100:00100000:0.0:1787784480.262804:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:9716:x1874627634677632:12345-192.168.202.59@tcp:101:chown.0 Request processed in 465us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.262811:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784480.268419:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.268712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634677760 00000100:00100000:0.0:1787784480.268722:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634677760 00000100:00100000:0.0:1787784480.268781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1787784480.268792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:9716:x1874627634677760:12345-192.168.202.59@tcp:101:chown.0 00010000:00010000:0.0:1787784480.268813:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784480.268833:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180030200/0xffb8d925c20baad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a935 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.268922:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.268936:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.268947:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.268977:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.268996:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269004:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269104:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269112:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269118:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784480.269158:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787784480.269163:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784480.269186:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269208:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269214:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269221:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269226:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180031800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.269230:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269238:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269250:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.269253:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784480.269257:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269262:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180031800/0xffb8d925c20baad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269274:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269280:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269285:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269297:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.269300:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269306:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269314:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff943183fdc500) 00010000:00010000:0.0:1787784480.269317:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784480.269320:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269326:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20baadf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269394:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180030200/0xffb8d925c20baad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a935 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269411:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a935 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.269419:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc100) 00010000:00010000:0.0:1787784480.269421:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784480.269423:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784480.269505:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:9716:x1874627634677760:12345-192.168.202.59@tcp:101:chown.0 Request processed in 715us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.269513:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:1.0:1787784480.274718:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.275132:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678016 00000100:00100000:0.0:1787784480.275156:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678016 00000100:00100000:0.0:1787784480.275273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784480.275283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:9716:x1874627634678016:12345-192.168.202.59@tcp:36:chown.0 00010000:00010000:0.0:1787784480.275338:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784480.275392:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a935 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.275413:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc100) 00010000:00010000:0.0:1787784480.275423:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784480.275460:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.275473:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.275481:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784480.341894:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787784480.342054:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6e3fb67 reply state 00000000394e8954 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784480.342069:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787784480.342228:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787784480.342442:0:5833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787784480.342468:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9716:x1874627634678016:12345-192.168.202.59@tcp:36:chown.0 Request processed in 67182us (67756us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787784480.342478:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00010000:00010000:1.0:1787784480.342558:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342568:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342576:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342581:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784480.342587:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342604:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342620:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc000) 00010000:00010000:1.0:1787784480.342623:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784480.342628:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784480.342635:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20baaed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784480.364626:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784480.364713:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678144 00000100:00100000:2.0:1787784480.364726:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678144 00000100:00100000:2.0:1787784480.364797:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784480.364808:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:9717:x1874627634678144:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:2.0:1787784480.364835:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784480.364857:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0800/0xffb8d925c20baaf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a93c expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784480.366077:0:8617:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1164us 00010000:00010000:0.0:1787784480.372573:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784480.425891:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.425923:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.425936:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.425952:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.425959:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.425966:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426461:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426471:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426479:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784480.426560:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787784480.426564:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784480.426661:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426678:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426714:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426720:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426727:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.426731:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426738:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426752:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.426754:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784480.426759:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426765:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20baafb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426778:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426785:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426790:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426795:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.426804:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426811:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426819:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff943183fdc100) 00010000:00010000:0.0:1787784480.426822:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784480.426824:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426830:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bab02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426867:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0800/0xffb8d925c20baaf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a93c expref: 8 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426883:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a93c expref: 7 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.426889:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784480.426891:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787784480.426893:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88800, rc 0) 00000100:00100000:0.0:1787784480.426970:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9717:x1874627634678144:12345-192.168.202.59@tcp:101:touch.500 Request processed in 62163us (62354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.426979:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784480.432642:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.434049:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678400 00000100:00100000:3.0:1787784480.434061:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678400 00000100:00100000:3.0:1787784480.434179:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784480.434191:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:9717:x1874627634678400:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:3.0:1787784480.434213:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784480.434234:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a943 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.434621:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.434636:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.434647:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.438605:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.438644:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.438656:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784480.439735:0:8618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787784480.440039:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440054:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440064:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440104:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440112:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440119:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440125:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.440129:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440136:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440160:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784480.440163:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.440168:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440174:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784480.440189:0:8618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b37ac36 reply state 00000000f1110a15 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.440198:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787784480.440239:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a943 expref: 10 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440254:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a943 expref: 9 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.440262:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784480.440264:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784480.440267:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611a00, rc 0) 00000100:00100000:3.0:1787784480.440354:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:9717:x1874627634678400:12345-192.168.202.59@tcp:101:touch.500 Request processed in 6166us (7720us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787784480.440396:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784480.456544:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1787784480.458008:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458023:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458030:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458035:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784480.458039:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458063:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458081:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff94319746ee00) 00010000:00010000:2.0:1787784480.458084:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784480.458089:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.458095:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.458466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678656 00000100:00100000:3.0:1787784480.458477:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678656 00000100:00100000:3.0:1787784480.458533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784480.458543:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:9717:x1874627634678656:12345-192.168.202.59@tcp:36:touch.500 00010000:00010000:3.0:1787784480.458610:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784480.458628:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a943 expref: 9 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.458640:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746ea00) 00010000:00010000:3.0:1787784480.458646:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784480.458703:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.458715:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.458723:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784480.458866:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2e59fd3 reply state 000000001516264c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.458875:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784480.458977:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:9717:x1874627634678656:12345-192.168.202.59@tcp:36:touch.500 Request processed in 434us (2443us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787784480.458997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784480.463287:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:3.0:1787784480.463343:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.463357:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784480.464145:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678784 00000100:00100000:0.0:1787784480.464160:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678784 00000100:00100000:0.0:1787784480.464237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:3.0:1787784480.464260:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784480.464266:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:9717:x1874627634678784:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:3.0:1787784480.464286:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.464293:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.464294:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784480.464321:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bab3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a94a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.464361:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.464413:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bab3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a94a expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.464429:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bab3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a94a expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.464459:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746e600) 00010000:00010000:0.0:1787784480.464462:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784480.464466:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89400, rc 0) 00000100:00100000:0.0:1787784480.464537:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:9717:x1874627634678784:12345-192.168.202.59@tcp:101:touch.500 Request processed in 275us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.464544:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:3.0:1787784480.464593:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746e600) 00010000:00010000:3.0:1787784480.464597:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.464603:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.464610:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.467711:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.470142:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634678912 00000100:00100000:0.0:1787784480.470158:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634678912 00000100:00100000:0.0:1787784480.470226:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784480.470235:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634678912:12345-192.168.202.59@tcp:8:touch.500 00010000:00080000:0.0:1787784480.470272:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1787784480.470310:0:6679:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20bab41 00002000:00100000:0.0:1787784480.470323:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9a4fd2c-0c67-4cd1-a267-69f5c190cff9/ffff9431bf3c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784480.470349:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1787784480.470622:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784480.470671:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9431bf3c1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784480.470760:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634678912:12345-192.168.202.59@tcp:8:touch.500 Request processed in 524us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.470768:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784480.476176:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784480.476290:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634679040 00000100:00100000:1.0:1787784480.476301:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634679040 00000100:00100000:1.0:1787784480.476515:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784480.476526:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:0:x1874627634679040:12345-192.168.202.59@tcp:2:touch.500 00000100:00080000:2.0:1787784480.480493:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787784480.573511:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000001:00080000:3.0:1787784480.573545:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787784480.573798:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:0:x1874627634679040:12345-192.168.202.59@tcp:2:touch.500 Request processed in 97268us (97627us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787784480.573809:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784480.582495:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.582749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634679296 00000100:00100000:3.0:1787784480.582759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634679296 00000100:00100000:3.0:1787784480.582818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1787784480.582828:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:9717:x1874627634679296:12345-192.168.202.59@tcp:35:touch.500 00000100:00100000:3.0:1787784480.583244:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:9717:x1874627634679296:12345-192.168.202.59@tcp:35:touch.500 Request processed in 417us (755us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787784480.583253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:1.0:1787784480.593444:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.593537:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634679424 00000100:00100000:3.0:1787784480.593548:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634679424 00000100:00100000:3.0:1787784480.593606:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784480.593627:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:9718:x1874627634679424:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:3.0:1787784480.593652:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784480.593674:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a951 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593742:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593756:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593767:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784480.593831:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787784480.593835:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784480.593879:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593906:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a951 expref: 13 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593922:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a951 expref: 12 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.593930:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784480.593932:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784480.593936:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611a00, rc 0) 00000100:00100000:3.0:1787784480.594008:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:9718:x1874627634679424:12345-192.168.202.59@tcp:101:rm.0 Request processed in 383us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784480.594025:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:0.0:1787784480.596458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784480.596595:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634679680 00000100:00100000:2.0:1787784480.596605:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634679680 00000100:00100000:2.0:1787784480.596659:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1787784480.596668:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:9718:x1874627634679680:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:2.0:1787784480.596688:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784480.596709:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bab56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a958 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784480.596827:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787784480.597002:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bab56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a958 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.597016:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:2.0:1787784480.597019:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784480.597023:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bab56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a958 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.597050:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1200, rc 0) 00000100:00100000:2.0:1787784480.597113:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:9718:x1874627634679680:12345-192.168.202.59@tcp:101:rm.0 Request processed in 446us (664us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787784480.597120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784480.601518:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.601641:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634679808 00000100:00100000:3.0:1787784480.601654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634679808 00000100:00100000:3.0:1787784480.601728:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1787784480.601740:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:9718:x1874627634679808:12345-192.168.202.59@tcp:37:rm.0 00000100:00100000:3.0:1787784480.607108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:9718:x1874627634679808:12345-192.168.202.59@tcp:37:rm.0 Request processed in 5351us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784480.607127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1787784480.612711:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784480.612811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634680064 00000100:00100000:2.0:1787784480.612828:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634680064 00000100:00100000:2.0:1787784480.612918:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784480.612930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac782050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:9718:x1874627634680064:12345-192.168.202.59@tcp:35:rm.0 00000100:00100000:2.0:1787784480.613236:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac782050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:9718:x1874627634680064:12345-192.168.202.59@tcp:35:rm.0 Request processed in 308us (539us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787784480.613244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784480.616166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784480.616850:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634680320 00000100:00100000:2.0:1787784480.616965:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634680320 00000100:00100000:2.0:1787784480.617102:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1787784480.617113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:9718:x1874627634680320:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:2.0:1787784480.617138:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784480.617160:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bab64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a95f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.617290:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bab6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.617306:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bab6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.617317:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bab6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784480.617344:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787784480.617558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bab64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a95f expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.617577:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bab6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a95f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.617585:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784480.617587:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784480.617591:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1000, rc 0) 00000100:00100000:2.0:1787784480.617657:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634680320:12345-192.168.202.59@tcp:101:rm.0 Request processed in 546us (1507us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787784480.617666:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:1.0:1787784480.620789:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.620906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634680448 00000100:00100000:0.0:1787784480.620919:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634680448 00000100:00100000:0.0:1787784480.620993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:0.0:1787784480.621005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634680448:12345-192.168.202.59@tcp:41:rm.0 00000004:00000024:0.0:1787784480.621081:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787784480.621175:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634680448:12345-192.168.202.59@tcp:41:rm.0 Request processed in 171us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784480.621184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:0.0:1787784480.623298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.623401:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634680576 00000100:00100000:3.0:1787784480.623414:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634680576 00000100:00100000:3.0:1787784480.623486:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:3.0:1787784480.623497:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634680576:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:3.0:1787784480.623524:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784480.623549:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a966 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623779:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623799:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623813:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623830:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623860:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.623868:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624002:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624011:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624018:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784480.624048:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784480.624053:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784480.624075:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624088:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624097:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624104:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624111:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624128:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.624133:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624142:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624156:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784480.624159:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.624165:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624171:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bab80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624188:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624194:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624200:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624206:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.624209:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624214:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624232:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff94319746ea00) 00010000:00010000:3.0:1787784480.624234:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.624237:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624243:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bab87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624278:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bab79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a966 expref: 18 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624293:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a966 expref: 17 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.624301:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746e600) 00010000:00010000:3.0:1787784480.624303:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784480.624306:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610c00, rc 0) 00000100:00100000:3.0:1787784480.624591:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:9718:x1874627634680576:12345-192.168.202.59@tcp:101:rm.0 Request processed in 1094us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784480.624600:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1787784480.631155:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.631259:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634680832 00000100:00100000:3.0:1787784480.631273:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634680832 00000100:00100000:3.0:1787784480.631347:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:3.0:1787784480.631359:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:9718:x1874627634680832:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:3.0:1787784480.631483:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787784480.631521:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bab8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a966 expref: 17 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631574:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bab3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a94a expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631589:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746e600) 00010000:00010000:3.0:1787784480.631621:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611a00/0xffb8d925c20bab4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a951 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631632:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784480.631636:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784480.631663:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631679:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631690:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631706:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631713:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631721:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631919:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631936:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.631943:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784480.632821:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787784480.632835:0:8618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295459469835ns, next at 296459467070ns, rc = 0 00010000:00010000:3.0:1787784480.632911:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632925:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632934:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632944:0:8618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632952:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632959:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.632979:0:8618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784480.633004:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633011:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633027:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633034:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.633040:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633049:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633062:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746ee00) 00010000:00010000:3.0:1787784480.633065:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787784480.633070:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633077:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20baba3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633100:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633107:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633113:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633119:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.633122:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633139:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633148:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784480.633150:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.633153:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.633159:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20bab95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784480.633169:0:8618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f3412e1 reply state 0000000029a0a9bd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784480.633180:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784480.633312:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634680832:12345-192.168.202.59@tcp:36:rm.0 Request processed in 1951us (2165us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787784480.633322:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00010000:00010000:0.0:1787784480.633644:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784480.633652:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.633660:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784480.633665:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.633672:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.633691:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94319746ee00) 00010000:00010000:0.0:1787784480.633694:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787784480.633697:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.633703:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20babaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.633721:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784480.633724:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784480.633725:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784480.637755:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637778:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637787:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637793:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784480.637798:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637807:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637852:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff94319746e200) 00010000:00010000:2.0:1787784480.637855:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784480.637860:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784480.637868:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bab9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784480.646207:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784480.646354:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681088 00000100:00100000:3.0:1787784480.646406:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681088 00000100:00100000:3.0:1787784480.646485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1787784480.646496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:9718:x1874627634681088:12345-192.168.202.59@tcp:35:rm.0 00000100:00100000:3.0:1787784480.646830:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634681088:12345-192.168.202.59@tcp:35:rm.0 Request processed in 334us (639us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787784480.646839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784480.657120:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784480.657214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681344 00000100:00100000:0.0:1787784480.657228:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681344 00000100:00100000:0.0:1787784480.657304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:0.0:1787784480.657316:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:9718:x1874627634681344:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:0.0:1787784480.657464:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787784480.657498:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bab6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a95f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657524:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88800/0xffb8d925c20bab09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a93c expref: 15 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657536:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784480.657554:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943180030c00/0xffb8d925c20baaca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a92e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657564:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784480.657590:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784480.657623:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657638:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657649:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657662:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657668:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.657674:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658045:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658055:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658063:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784480.658809:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787784480.658832:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658841:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658855:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658861:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.658866:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658873:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658885:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff943183fdc000) 00010000:00010000:0.0:1787784480.658889:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787784480.658893:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658900:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20babbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658927:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658933:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658939:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658944:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784480.658947:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658963:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658971:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc100) 00010000:00010000:0.0:1787784480.658974:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784480.658977:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784480.658983:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20babb1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784480.658994:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081556c14 reply state 000000000aa7de81 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784480.659004:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784480.659102:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:9718:x1874627634681344:12345-192.168.202.59@tcp:36:rm.0 Request processed in 1784us (1994us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787784480.659112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00010000:00010000:3.0:1787784480.661214:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661236:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661263:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661270:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784480.661275:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661283:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661300:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff943183fdc900) 00010000:00010000:3.0:1787784480.661304:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784480.661309:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784480.661316:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20babb8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784481.396611:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784481.588820:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643105280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784481.588923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784481.589114:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105280 00000100:00100000:1.0:1787784481.589125:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105280 00000100:00100000:1.0:1787784481.589211:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787784481.589223:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643105280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784481.589279:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784481.589350:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643105280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784481.589359:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787784481.589483:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b3fbe580 x1874627643105280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784481.589505:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643105280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784481.590071:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784482.426954:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784483.126094:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643105408:0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.126174:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.126260:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105408 00000100:00100000:0.0:1787784483.126267:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105408 00000100:00100000:0.0:1787784483.126316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787784483.126325:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643105408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.126429:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643105408:12345-0@lo:400:kworker.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.126437:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787784483.126486:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643105408:0@lo:400:kworker.0 00000100:00100000:3.0:1787784483.126621:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643105536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784483.126656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.126770:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643105664:0@lo:400:kworker.0 00000100:00100000:1.0:1787784483.126857:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643105792:0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.135092:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105536 00000100:00100000:0.0:1787784483.135101:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105536 00000100:00100000:0.0:1787784483.135158:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105664 00000100:00100000:0.0:1787784483.135162:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105664 00000100:00100000:0.0:1787784483.135194:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784483.135203:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643105536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135277:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643105536:12345-0@lo:400:kworker.0 Request processed in 76us (8620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.135285:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787784483.135302:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787784483.135309:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643105664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135342:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643105664:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.135348:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787784483.135384:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784483.135429:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643105664:0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135461:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643105920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135494:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.135523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105920 00000100:00100000:0.0:1787784483.135539:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105920 00000100:00100000:0.0:1787784483.135567:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787784483.135574:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643105920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.135608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643105920:12345-0@lo:400:kworker.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.135614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787784483.135627:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784483.135644:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643105920:0@lo:400:kworker.0 00000100:00100000:3.0:1787784483.145770:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf6992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643105536:0@lo:400:kworker.0 00000100:00100000:3.0:1787784483.145783:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643106048:0@lo:400:kworker.0 00000100:00100000:3.0:1787784483.145839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784483.145992:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106048 00000100:00100000:0.0:1787784483.146000:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106048 00000100:00100000:0.0:1787784483.146065:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787784483.146073:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643106048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.146130:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643106048:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.146137:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784483.146326:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784483.146429:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784483.146451:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431962a43c0 x1874627643106048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784483.146462:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643106048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.146528:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643105792 00000100:00100000:0.0:1787784483.146532:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643105792 00000100:00100000:0.0:1787784483.146568:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787784483.146573:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643105792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784483.146605:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643105792:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784483.146610:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787784483.146653:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787784483.146861:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf69bc00 x1874627643105792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784483.146872:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643105792:0@lo:400:kworker.0 00010000:00010000:0.0:1787784483.445895:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784483.637961:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643106176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784483.638043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784483.638744:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106176 00000100:00100000:1.0:1787784483.638753:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106176 00000100:00100000:1.0:1787784483.638813:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787784483.638823:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643106176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784483.638860:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784483.638933:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643106176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784483.638940:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787784483.639061:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bfac6940 x1874627643106176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784483.639082:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643106176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787784484.469978:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784484.603125:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784484.603160:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784484.603188:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784484.603256:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784484.603336:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681728 00000100:00100000:0.0:1787784484.603340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681472 00000100:00100000:0.0:1787784484.603346:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681472 00000100:00100000:2.0:1787784484.603440:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681728 00000100:00100000:0.0:1787784484.603454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 256 00000100:00100000:0.0:1787784484.603464:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634681472:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784484.603484:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1787784484.603492:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634681728:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784484.603555:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634681728:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784484.603563:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00080000:2.0:1787784484.603584:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784484.603933:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681600 00000100:00100000:3.0:1787784484.603938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681600 00000100:00100000:3.0:1787784484.603970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681856 00000100:00100000:3.0:1787784484.603973:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681856 00000100:00100000:3.0:1787784484.603991:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:3.0:1787784484.603997:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2365:x1874627634681600:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784484.604070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:1.0:1787784484.604078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634681856:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784484.604934:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634681472:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1466us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784484.604953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 256 00000100:00080000:0.0:1787784484.605013:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784484.607045:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2365:x1874627634681600:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3038us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784484.607056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:1.0:1787784484.607542:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634681856:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3461us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784484.607551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00010000:00010000:1.0:1787784485.501418:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784485.566850:0:11609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1787784485.778243:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787784485.778278:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787784485.778569:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643106304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787784485.778676:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784485.778811:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106304 00000100:00100000:3.0:1787784485.778821:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106304 00000100:00100000:3.0:1787784485.778894:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784485.778905:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643106304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787784485.778936:0:8198:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787784485.778978:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f6d20, atime: 0x6a8f6d20, ctime: 0x6a8f6d20, blocks: 0x1 00010000:00010000:3.0:1787784485.778988:0:8198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784485.779009:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1787784485.779014:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784485.779021:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784485.779043:0:8198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784485.779067:0:8198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784485.779077:0:8198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784485.779094:0:8198:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784485.779828:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643106304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 921us (1149us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787784485.779841:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787784485.779911:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9431beed9680/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787784485.779918:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643106304:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1787784485.779998:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784485.780113:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784485.780122:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784485.780137:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784485.780142:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784485.780155:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784485.780180:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784485.780188:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe27f9c/0xffb8d925c20babc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784485.780207:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784485.780217:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784485.780220:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784486.525831:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787784486.610876:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff325d6b30 20000000:00000080:1.0:1787784486.610900:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431bf52c800 uarg=0000000000000000 20000000:01000000:1.0:1787784486.610946:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787784486.610954:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787784486.610960:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787784486.612309:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787784486.612555:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787784486.621626:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787784486.623175:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787784486.623277:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787784486.623300:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784486.623326:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623347:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623356:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623387:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623417:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623425:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623434:0:11658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623491:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.623510:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 12 pid: 5823 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.623529:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106432:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784486.624916:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.625009:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 12 pid: 5825 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.625024:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106560:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784486.635966:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.635991:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 18 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.636034:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106688:0@lo:104: 00000100:00100000:3.0:1787784486.636140:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784486.636207:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.636217:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 18 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.636225:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106816:0@lo:104: 00000100:00100000:3.0:1787784486.636249:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784486.636281:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.636290:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 18 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.636299:0:11658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106944:0@lo:104: 00000100:00100000:3.0:1787784486.636323:0:11658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784486.636414:0:8442:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787784486.636431:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106688 00000100:00100000:3.0:1787784486.636440:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106688 00000100:00100000:3.0:1787784486.636487:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106816 00000100:00100000:3.0:1787784486.636491:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106816 00000100:00100000:3.0:1787784486.636501:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643106944 00000100:00100000:3.0:1787784486.636503:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643106944 00000100:00100000:3.0:1787784486.636518:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784486.636526:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:11658:x1874627643106688:12345-0@lo:104: 00010000:00010000:3.0:1787784486.636541:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.636596:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784486.636602:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+5:11658:x1874627643106688:12345-0@lo:104: Request processed in 77us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784486.636611:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787784486.636632:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784486.636944:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11658:x1874627643106816:12345-0@lo:104: 00010000:00010000:3.0:1787784486.636953:0:8442:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784486.636990:0:8442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787784486.636994:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11658:x1874627643106816:12345-0@lo:104: Request processed in 57us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784486.637235:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784486.637248:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11658:x1874627643106944:12345-0@lo:104: 00010000:00010000:1.0:1787784486.637257:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.637292:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787784486.637297:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+4:11658:x1874627643106944:12345-0@lo:104: Request processed in 54us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784486.637303:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787784486.637327:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784486.637333:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.637505:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784486.637536:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784486.637561:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634681984 00000100:00100000:2.0:1787784486.637567:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634681984 00010000:00010000:2.0:1787784486.637597:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 13 pid: 5823 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.637621:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682112 00000100:00100000:2.0:1787784486.637624:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682112 00010000:00010000:2.0:1787784486.637698:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 14 pid: 5825 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.637720:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784486.637728:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+14:2363:x1874627634681984:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784486.637740:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784486.637747:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 14 pid: 5823 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.637761:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 14 pid: 5823 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.637786:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784486.637831:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+14:2363:x1874627634681984:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 105us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784486.637838:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784486.637851:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1787784486.637857:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634682112:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784486.637865:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784486.637881:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 13 pid: 5825 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.637892:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 13 pid: 5825 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.637903:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784486.637920:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634682112:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 64us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784486.638089:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00010000:00010000:1.0:1787784486.638549:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784486.638555:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638564:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784486.638571:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784486.638588:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784486.638651:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638658:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784486.638683:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638689:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1e00/0xffb8d925c20baa84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638707:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784486.638710:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638715:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1600 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784486.638718:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638725:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784486.638730:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784486.638735:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784486.638751:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638757:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784486.638777:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638784:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1600/0xffb8d925c20baa76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa7d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638794:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784486.638797:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638803:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784486.638806:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638813:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784486.638818:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784486.638824:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787784486.638854:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638860:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784486.638866:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638872:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20baa68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20baa6f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784486.638886:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784486.638893:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784486.638894:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784486.638904:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784486.638924:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643107072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784486.639083:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784486.639132:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643107200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784486.639156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784486.639172:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784486.639177:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643107328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784486.639196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787784486.639284:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784486.639421:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107072 00000100:00100000:2.0:1787784486.639429:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107072 00010000:00010000:2.0:1787784486.639458:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 19 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.639491:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107200 00000100:00100000:2.0:1787784486.639494:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107200 00010000:00010000:2.0:1787784486.639506:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 20 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.639514:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107328 00000100:00100000:2.0:1787784486.639516:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107328 00010000:00010000:2.0:1787784486.639526:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 21 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.639538:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784486.639545:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3293:x1874627643107072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784486.639557:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784486.639560:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 21 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.639583:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 21 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.639600:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784486.639724:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784486.639734:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3295:x1874627643107200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784486.639745:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784486.639750:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 21 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639760:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 21 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639770:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784486.639802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3295:x1874627643107200:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784486.639809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784486.639826:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784486.639832:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3295:x1874627643107328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784486.639839:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784486.639842:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 20 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639851:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 20 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639876:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639886:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639905:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639913:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639920:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639939:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639945:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784486.639950:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639959:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639967:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784486.639978:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784486.640001:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3295:x1874627643107328:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784486.640016:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784486.640055:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643107328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784486.640064:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643107200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784486.640224:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643107072:12345-0@lo:103:ldlm_bl.0 Request processed in 678us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784486.640231:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784486.640438:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643107072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784486.640624:0:11658:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431919a1540 going to sleep for 11 seconds 00010000:00010000:2.0:1787784486.640660:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611400/0xffb8d925c20baa99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a920 expref: 12 pid: 5823 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.640674:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fba580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106432:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784486.640687:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611000/0xffb8d925c20baa92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a919 expref: 11 pid: 5825 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.640695:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106560:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784486.640706:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0800/0xffb8d925c20baa8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa84 expref: 18 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.640716:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106688:0@lo:104: 00010000:00010000:2.0:1787784486.640726:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0600/0xffb8d925c20baa7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa76 expref: 17 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.640734:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106816:0@lo:104: 00010000:00010000:2.0:1787784486.640746:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1a00/0xffb8d925c20baa6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20baa68 expref: 16 pid: 5826 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784486.640768:0:11658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1874627643106944:0@lo:104: 00010000:00010000:2.0:1787784486.640791:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.640801:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.640807:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784486.640813:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610e00/0xffb8d925c20babcd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784486.642622:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787784486.712197:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784486.712230:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643107456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784486.712326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784486.714156:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107456 00000100:00100000:3.0:1787784486.714175:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107456 00000100:00100000:3.0:1787784486.714251:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787784486.714264:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643107456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784486.714310:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784486.714589:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643107456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 327us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784486.714598:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784486.715598:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643107456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784487.541440:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784487.867624:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784487.867919:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682240 00000100:00100000:2.0:1787784487.867934:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682240 00000100:00100000:2.0:1787784487.868017:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 257 00000100:00100000:2.0:1787784487.868030:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:5609:x1874627634682240:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784487.868057:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784487.868086:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1200/0xffb8d925c20babd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a96d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.868126:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1200/0xffb8d925c20babd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a96d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.868166:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1200/0xffb8d925c20babd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a96d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.868177:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1200, rc 0) 00000100:00100000:2.0:1787784487.868267:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682240:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 239us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784487.868276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 257 00000100:00100000:2.0:1787784487.873681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784487.873821:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682368 00000100:00100000:0.0:1787784487.873835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682368 00000100:00100000:0.0:1787784487.873911:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 258 00000100:00100000:0.0:1787784487.873924:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682368:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784487.874424:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682368:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 444us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784487.874435:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 258 00000100:00100000:3.0:1787784487.878038:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784487.879705:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682496 00000100:00100000:0.0:1787784487.879725:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682496 00000100:00100000:0.0:1787784487.879884:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 259 00000100:00100000:0.0:1787784487.879897:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682496:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784487.880315:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682496:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 420us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784487.880325:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 259 00000100:00100000:1.0:1787784487.894876:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784487.894970:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682624 00000100:00100000:3.0:1787784487.894984:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682624 00000100:00100000:3.0:1787784487.895057:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 260 00000100:00100000:3.0:1787784487.895069:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:9988:x1874627634682624:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784487.895467:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:9988:x1874627634682624:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 399us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784487.895478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 260 00000100:00100000:2.0:1787784487.899100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784487.900111:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682752 00000100:00100000:3.0:1787784487.900128:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682752 00000100:00100000:3.0:1787784487.900275:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 261 00000100:00100000:3.0:1787784487.900289:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:9988:x1874627634682752:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784487.900673:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:9988:x1874627634682752:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 384us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784487.900683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 261 00000100:00100000:0.0:1787784487.916849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784487.917661:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634682880 00000100:00100000:2.0:1787784487.917676:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634682880 00000100:00100000:2.0:1787784487.917759:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 262 00000100:00100000:2.0:1787784487.917772:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:5609:x1874627634682880:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784487.917797:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784487.917825:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20babdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849a974 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.917864:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20babdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a974 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.917876:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20babdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a974 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.917887:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1600, rc 0) 00000100:00100000:2.0:1787784487.917960:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634682880:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784487.917989:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 262 00000100:00100000:0.0:1787784487.924728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784487.924833:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683008 00000100:00100000:3.0:1787784487.924847:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683008 00000100:00100000:3.0:1787784487.924929:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 263 00000100:00100000:2.0:1787784487.924976:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634683008:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784487.925456:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634683008:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 513us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784487.925466:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 263 00000100:00100000:0.0:1787784487.938257:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784487.939330:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683136 00000100:00100000:1.0:1787784487.939347:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683136 00000100:00100000:1.0:1787784487.939490:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 264 00000100:00100000:1.0:1787784487.939502:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634683136:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784487.939813:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:5609:x1874627634683136:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 311us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784487.939821:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 264 00000100:00100000:3.0:1787784487.951986:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784487.952218:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683264 00000100:00100000:0.0:1787784487.952231:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683264 00000100:00100000:0.0:1787784487.952305:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 265 00000100:00100000:0.0:1787784487.952337:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:9991:x1874627634683264:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784487.952765:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:9991:x1874627634683264:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 428us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784487.952774:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 265 00000100:00100000:0.0:1787784487.957821:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784487.958071:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683392 00000100:00100000:2.0:1787784487.958085:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683392 00000100:00100000:2.0:1787784487.958158:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 266 00000100:00100000:2.0:1787784487.958169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:9991:x1874627634683392:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784487.958536:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:9991:x1874627634683392:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 367us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784487.958547:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 266 10000000:01000000:2.0:1787784487.990002:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784487.990014:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431bf2b0000 from 7 10000000:01000000:2.0:1787784487.990022:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784487.990101:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.990116:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784487.990129:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784487.990164:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784487.990260:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784487.990462:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885af300 going to sleep for 11 seconds 00000100:00100000:1.0:1787784487.992101:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107584 00000100:00100000:1.0:1787784487.992119:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107584 00000100:00100000:1.0:1787784487.995645:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787784487.995676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:5828:x1874627643107584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784487.995701:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784487.995725:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1000/0xffb8d925c20babe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20babe2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784487.995786:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1000/0xffb8d925c20babe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20babe2 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784487.995800:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1000/0xffb8d925c20babe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20babe2 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784487.995812:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1000, rc 0) 00000100:00100000:1.0:1787784487.995934:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643107584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (5674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784487.995943:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787784487.996253:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784487.996277:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784487.996289:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784487.996432:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784487.996476:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784487.996508:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431919a1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784487.996570:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107712 00000100:00100000:0.0:1787784487.996577:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107712 00000100:00100000:0.0:1787784487.996627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787784487.996636:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643107712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784487.996969:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643107712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784487.996977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787784487.997182:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784487.997234:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784487.997279:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784487.997298:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431919a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784487.997415:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107840 00000100:00100000:2.0:1787784487.997419:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107840 00000100:00100000:2.0:1787784487.997445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787784487.997452:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643107840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784487.997778:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643107840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784487.997786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787784488.000047:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643107840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.001433:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11671:1874627643107968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784488.001539:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.001596:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591840 going to sleep for 11 seconds 00000100:00100000:2.0:1787784488.002419:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643107968 00000100:00100000:2.0:1787784488.002434:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643107968 00000100:00100000:2.0:1787784488.002500:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787784488.002512:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:11671:x1874627643107968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784488.002821:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:11671:x1874627643107968:12345-0@lo:502:llog_process_th.0 Request processed in 309us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784488.002830:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787784488.003213:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11671:1874627643107968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784488.003256:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784488.003270:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784488.003273:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787784488.003282:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431bf2b0000 00000020:00000080:0.0:1787784488.003285:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787784488.003447:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11671:1874627643108096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784488.003495:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.003541:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784488.003828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108096 00000100:00100000:3.0:1787784488.003835:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108096 00000100:00100000:3.0:1787784488.003884:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787784488.003893:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:11671:x1874627643108096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784488.004111:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:11671:x1874627643108096:12345-0@lo:502:llog_process_th.0 Request processed in 219us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784488.004119:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787784488.004277:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11671:1874627643108096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784488.004302:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784488.004312:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784488.004314:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787784488.004320:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787784488.007024:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787784488.007070:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784488.007085:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784488.007099:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784488.007112:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787784488.007115:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9ffe000 from 7 10000000:01000000:3.0:1787784488.007118:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784488.007165:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784488.007175:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784488.007198:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784488.007230:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784488.007318:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784488.007425:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431919a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.007535:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108224 00000100:00100000:1.0:1787784488.007545:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108224 00000100:00100000:1.0:1787784488.007604:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787784488.007616:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:5828:x1874627643108224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784488.007643:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784488.007658:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1600/0xffb8d925c20babf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20babf0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784488.007689:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1600/0xffb8d925c20babf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20babf0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784488.007701:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1600/0xffb8d925c20babf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20babf0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784488.007719:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1600, rc 0) 00000100:00100000:1.0:1787784488.007771:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.007778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787784488.007952:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784488.007979:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784488.007988:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784488.008059:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.008090:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.008125:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.008244:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108352 00000100:00100000:1.0:1787784488.008249:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108352 00000100:00100000:1.0:1787784488.008279:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787784488.008287:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784488.008658:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 371us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.008666:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787784488.009192:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.009247:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.009303:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.009338:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784488.009398:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108480 00000100:00100000:0.0:1787784488.009403:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108480 00000100:00100000:0.0:1787784488.009431:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787784488.009439:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.009642:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784488.009650:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787784488.009695:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787784488.011396:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11672:1874627643108608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784488.011478:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.011519:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.013061:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108608 00000100:00100000:1.0:1787784488.013081:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108608 00000100:00100000:1.0:1787784488.013163:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787784488.013177:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:11672:x1874627643108608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784488.013536:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:11672:x1874627643108608:12345-0@lo:502:llog_process_th.0 Request processed in 361us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.013545:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787784488.014319:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11672:1874627643108608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784488.014411:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784488.014423:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784488.014426:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787784488.014435:0:11672:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431b9ffe000 00000020:00000080:0.0:1787784488.014438:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787784488.014537:0:11672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11672:1874627643108736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784488.014598:0:11672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.014655:0:11672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.014821:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108736 00000100:00100000:1.0:1787784488.014828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108736 00000100:00100000:1.0:1787784488.014868:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787784488.014877:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:11672:x1874627643108736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784488.015103:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:11672:x1874627643108736:12345-0@lo:502:llog_process_th.0 Request processed in 227us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.015112:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787784488.015515:0:11672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11672:1874627643108736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787784488.015545:0:11672:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784488.015552:0:11672:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784488.015554:0:11672:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787784488.015558:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787784488.019468:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787784488.019519:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784488.019535:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784488.019549:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784488.019562:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784488.019566:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff94318875c800 from 7 10000000:01000000:2.0:1787784488.019568:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784488.019623:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784488.019656:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784488.019686:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784488.019721:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784488.019811:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.019872:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784488.019999:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108864 00000100:00100000:0.0:1787784488.020010:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108864 00000100:00100000:0.0:1787784488.020074:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787784488.020085:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:5828:x1874627643108864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784488.020102:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784488.020119:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88800/0xffb8d925c20bac05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20babfe expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784488.020224:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88800/0xffb8d925c20bac05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20babfe expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784488.020237:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88800/0xffb8d925c20bac05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20babfe expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784488.020248:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88800, rc 0) 00000100:00100000:0.0:1787784488.020297:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643108864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784488.020305:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787784488.025267:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784488.025316:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784488.025332:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784488.025500:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784488.025582:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.025639:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.025713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643108992 00000100:00100000:1.0:1787784488.025721:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643108992 00000100:00100000:1.0:1787784488.025779:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787784488.025791:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643108992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784488.026158:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643108992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.026166:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787784488.027330:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643108992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784488.027446:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643109120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784488.027522:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.027564:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.028090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109120 00000100:00100000:1.0:1787784488.028100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109120 00000100:00100000:1.0:1787784488.028164:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787784488.028175:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643109120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784488.029566:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:5828:x1874627643109120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1383us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.029580:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787784488.030960:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:5828:1874627643109120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784488.032642:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11675:1874627643109248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784488.032750:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.032795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109248 00000100:00100000:3.0:1787784488.032803:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784488.032803:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109248 00000100:00100000:2.0:1787784488.032874:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787784488.032884:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:11675:x1874627643109248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784488.033152:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:11675:x1874627643109248:12345-0@lo:502:llog_process_th.0 Request processed in 268us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784488.033161:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787784488.036761:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11675:1874627643109248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784488.036832:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784488.036850:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784488.036853:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784488.036865:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94318875c800 00000020:00000080:3.0:1787784488.036869:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787784488.036991:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11675:1874627643109376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787784488.037089:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784488.037158:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784488.037231:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109376 00000100:00100000:1.0:1787784488.037240:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109376 00000100:00100000:1.0:1787784488.037305:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787784488.037316:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:11675:x1874627643109376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784488.037628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:11675:x1874627643109376:12345-0@lo:502:llog_process_th.0 Request processed in 313us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784488.037638:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787784488.038097:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:11675:1874627643109376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784488.038131:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784488.038138:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784488.038140:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784488.038158:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787784488.038438:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787784488.038465:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787784488.038479:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784488.038491:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784488.049719:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784488.245163:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643109632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784488.245206:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643109504:0@lo:400:kworker.0 00000100:00100000:1.0:1787784488.245289:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643109888:0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.248548:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643109760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784488.250042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.250159:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643110144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.250178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784488.250260:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109632 00000100:00100000:3.0:1787784488.250270:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109632 00000100:00100000:3.0:1787784488.250328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109760 00000100:00100000:3.0:1787784488.250331:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109760 00000100:00100000:3.0:1787784488.250469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787784488.250479:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643109632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.250543:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643109632:12345-0@lo:400:kworker.0 Request processed in 66us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784488.250551:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787784488.250575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784488.250581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643109760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.250614:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643109760:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784488.250728:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.250764:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643110016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784488.250795:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784488.250838:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784488.250874:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110016 00000100:00100000:2.0:1787784488.250878:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110016 00000100:00100000:3.0:1787784488.251055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787784488.251082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109504 00000100:00100000:3.0:1787784488.251161:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109504 00000100:00100000:3.0:1787784488.251191:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787784488.251198:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643109504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.251241:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643109504:12345-0@lo:400:kworker.0 Request processed in 44us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784488.251247:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787784488.251309:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643109760:0@lo:400:kworker.0 00000100:00100000:2.0:1787784488.251449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787784488.251457:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643110016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784488.251470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784488.251491:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643110016:12345-0@lo:400:kworker.0 Request processed in 37us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784488.251497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787784488.251509:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643109632:0@lo:400:kworker.0 00000100:00080000:2.0:1787784488.251515:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784488.251525:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110144 00000100:00100000:2.0:1787784488.251528:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110144 00000100:00100000:2.0:1787784488.251559:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787784488.251567:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643110144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784488.251601:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643110144:12345-0@lo:400:kworker.0 Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784488.251607:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787784488.251624:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bed84000 x1874627643110144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784488.251636:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643110144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.251733:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643109504:0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.251747:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643110016:0@lo:400:kworker.0 00000100:00080000:2.0:1787784488.251818:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784488.251897:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784488.252067:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643109888 00000100:00100000:3.0:1787784488.252072:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643109888 00000100:00100000:3.0:1787784488.252270:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784488.252279:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643109888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784488.252350:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643109888:12345-0@lo:400:kworker.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784488.252358:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787784488.252432:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784488.252553:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643109888:0@lo:400:kworker.0 00010000:00010000:0.0:1787784488.564674:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784488.757117:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784488.757159:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643110272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784488.757256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784488.757678:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110272 00000100:00100000:0.0:1787784488.757689:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110272 00000100:00100000:0.0:1787784488.757760:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784488.757771:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643110272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784488.757827:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784488.757896:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643110272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784488.757903:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787784488.758744:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9e00 x1874627643110272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784488.758769:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643110272:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787784489.078553:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784489.588786:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784489.723292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784489.723418:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683520 00000100:00100000:3.0:1787784489.723424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784489.723431:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683520 00000100:00100000:3.0:1787784489.723453:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784489.723482:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683648 00000100:00100000:3.0:1787784489.723486:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683648 00000100:00100000:0.0:1787784489.723493:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 283 00000100:00100000:0.0:1787784489.723504:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634683520:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784489.723528:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683904 00000100:00100000:3.0:1787784489.723531:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683904 00000100:00100000:3.0:1787784489.723549:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:3.0:1787784489.723556:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634683648:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784489.723643:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:1.0:1787784489.723655:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634683904:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784489.723703:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634683520:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784489.723712:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 283 00000100:00080000:2.0:1787784489.723765:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784489.724063:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634683648:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 506us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784489.724083:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:3.0:1787784489.729013:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784489.729693:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634683776 00000100:00100000:2.0:1787784489.729706:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634683776 00000100:00100000:2.0:1787784489.729802:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:2.0:1787784489.729814:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634683776:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784489.729916:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634683776:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 105us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784489.729924:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00080000:3.0:1787784489.730435:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784489.731043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634683904:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 7382us (7579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784489.731057:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00010000:00010000:0.0:1787784490.612609:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787784490.873905:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787784491.636983:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784491.828635:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784491.828659:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643110400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784491.828730:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784491.828856:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110400 00000100:00100000:2.0:1787784491.828863:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110400 00000100:00100000:2.0:1787784491.828929:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787784491.828941:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643110400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784491.828979:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784491.829024:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643110400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784491.829032:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787784491.830444:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784491.830482:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787784491.830489:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9431beed9680, transno 4294967300 00000100:00100000:1.0:1787784491.830513:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643110400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787784492.660943:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784493.364830:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643110656:0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.364830:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643110912:0@lo:400:kworker.0 00000100:00100000:2.0:1787784493.364910:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643110528:0@lo:400:kworker.0 00000100:00100000:1.0:1787784493.367809:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643110784:0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.370425:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784493.370521:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110912 00000100:00100000:0.0:1787784493.370530:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110912 00000100:00100000:0.0:1787784493.370596:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787784493.370606:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643110912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.370663:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643110912:12345-0@lo:400:kworker.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784493.370671:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787784493.370696:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784493.370728:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643110912:0@lo:400:kworker.0 00000100:00100000:3.0:1787784493.371826:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784493.371887:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643111168:0@lo:400:kworker.0 00000100:00100000:3.0:1787784493.371916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784493.371958:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111168 00000100:00100000:3.0:1787784493.371972:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111168 00000100:00100000:3.0:1787784493.372014:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784493.372021:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643111168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784493.372063:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643111168:12345-0@lo:400:kworker.0 Request processed in 43us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784493.372069:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787784493.372091:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784493.372114:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9f04000 x1874627643111168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784493.372125:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643111168:0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.372389:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110656 00000100:00100000:0.0:1787784493.372394:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110656 00000100:00100000:0.0:1787784493.372435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787784493.372443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643110656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.372485:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643110656:12345-0@lo:400:kworker.0 Request processed in 43us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784493.372491:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787784493.373609:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643110656:0@lo:400:kworker.0 00000100:00100000:2.0:1787784493.378753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784493.379720:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643111040:0@lo:400:kworker.0 00000100:00100000:2.0:1787784493.379773:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784493.379811:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110528 00000100:00100000:3.0:1787784493.379821:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110528 00000100:00100000:3.0:1787784493.379881:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787784493.379892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643110528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784493.379949:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643110528:12345-0@lo:400:kworker.0 Request processed in 59us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784493.379957:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787784493.380076:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111040 00000100:00100000:0.0:1787784493.380080:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111040 00000100:00100000:0.0:1787784493.380137:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787784493.380146:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643111040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784493.380172:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643110528:0@lo:400:kworker.0 00000100:00080000:3.0:1787784493.380220:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784493.380329:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643111040:12345-0@lo:400:kworker.0 Request processed in 184us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784493.380336:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787784493.380969:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784493.381094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643110784 00000100:00100000:0.0:1787784493.381099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643110784 00000100:00100000:0.0:1787784493.381295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787784493.381304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643110784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784493.381362:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643110784:12345-0@lo:400:kworker.0 Request processed in 59us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784493.381389:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787784493.381500:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643110784:0@lo:400:kworker.0 00000100:00080000:3.0:1787784493.381569:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784493.384293:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643111040:0@lo:400:kworker.0 00010000:00010000:1.0:1787784493.685052:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784493.877764:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784493.877790:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643111296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784493.877881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784493.878052:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111296 00000100:00100000:2.0:1787784493.878060:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111296 00000100:00100000:2.0:1787784493.878124:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784493.878150:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643111296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784493.878186:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784493.878247:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643111296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784493.878255:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787784493.878290:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9e00 x1874627643111296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784493.878323:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643111296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784494.709039:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784494.841808:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784494.841953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784494.842169:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784494.842238:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684032 00000100:00100000:0.0:1787784494.842255:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684032 00000100:00100000:0.0:1787784494.842347:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 285 00000100:00100000:0.0:1787784494.842358:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634684032:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784494.842480:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634684032:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 124us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.842488:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 285 00000100:00100000:3.0:1787784494.846355:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784494.846765:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684288 00000100:00100000:0.0:1787784494.846775:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684288 00000100:00100000:0.0:1787784494.846862:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:0.0:1787784494.846872:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634684288:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784494.846947:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634684288:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 77us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.846954:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00080000:3.0:1787784494.847715:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784494.849541:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684160 00000100:00100000:1.0:1787784494.849556:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684160 00000100:00100000:1.0:1787784494.849839:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684416 00000100:00100000:1.0:1787784494.849843:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684416 00000100:00100000:0.0:1787784494.849899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:0.0:1787784494.849911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634684160:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784494.850013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634684160:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 104us (8059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784494.850021:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00080000:3.0:1787784494.856435:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784494.859202:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:1.0:1787784494.859231:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634684416:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784494.859332:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634684416:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 106us (17162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784494.859340:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 128 00010000:00010000:1.0:1787784495.732593:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784496.758400:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784496.952106:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784496.952131:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643111424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784496.952198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784496.952269:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111424 00000100:00100000:2.0:1787784496.952277:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111424 00000100:00100000:2.0:1787784496.952348:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784496.952359:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643111424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784496.952417:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784496.952463:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643111424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784496.952471:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784496.952557:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643111424:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784496.953358:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787784497.787314:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784498.485596:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643111552:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485669:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485721:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643112064:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485749:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485771:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784498.485777:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643111936:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485801:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485839:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643111808:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485879:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784498.485884:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643111680:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485919:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485939:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643112192:0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.485960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.485986:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111936 00000100:00100000:3.0:1787784498.485993:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111936 00000100:00100000:3.0:1787784498.486041:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112192 00000100:00100000:3.0:1787784498.486044:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112192 00000100:00100000:3.0:1787784498.486066:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784498.486074:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643111936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.486124:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643111936:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784498.486132:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784498.486155:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787784498.486161:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643112192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.486194:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643112192:12345-0@lo:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784498.486199:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787784498.486489:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784498.486493:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787784498.486501:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bed86d00 x1874627643112192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784498.486508:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112064 00000100:00100000:1.0:1787784498.486511:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112064 00000100:00100000:3.0:1787784498.486516:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643112192:0@lo:400:kworker.0 00000100:00100000:1.0:1787784498.486543:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111808 00000100:00100000:1.0:1787784498.486546:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111808 00000100:00100000:3.0:1787784498.486548:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643111936:0@lo:400:kworker.0 00000100:00100000:1.0:1787784498.486564:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111680 00000100:00100000:1.0:1787784498.486567:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111680 00000100:00100000:1.0:1787784498.486579:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787784498.486585:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643112064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.486589:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787784498.486595:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643111808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784498.486622:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643111808:12345-0@lo:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784498.486624:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643112064:12345-0@lo:400:kworker.0 Request processed in 40us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784498.486629:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787784498.486701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643111552 00000100:00100000:0.0:1787784498.486706:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643111552 00000100:00100000:0.0:1787784498.486737:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787784498.486744:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643111552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784498.486778:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643111552:12345-0@lo:400:kworker.0 Request processed in 35us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784498.486795:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787784498.487790:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643111808:0@lo:400:kworker.0 00000100:00100000:2.0:1787784498.487854:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643111552:0@lo:400:kworker.0 00000100:00100000:2.0:1787784498.487866:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643112064:0@lo:400:kworker.0 00000100:00100000:1.0:1787784498.490815:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787784498.490876:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787784498.490895:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643111680:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787784498.491470:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784498.491520:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643111680:0@lo:400:kworker.0 00000100:00100000:1.0:1787784498.491543:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643111680:12345-0@lo:400:kworker.0 Request processed in 655us (5621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784498.491567:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00010000:0.0:1787784498.805122:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784498.996670:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784498.996695:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643112320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784498.996783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784498.996975:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112320 00000100:00100000:3.0:1787784498.996983:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112320 00000100:00100000:3.0:1787784498.997049:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787784498.997058:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643112320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784498.997092:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784498.997144:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643112320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784498.997150:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787784498.997302:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431beed9e00 x1874627643112320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784498.997323:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643112320:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787784499.317191:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784499.828649:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784499.966540:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784499.966608:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784499.966895:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684672 00000100:00100000:1.0:1787784499.966915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684672 00000100:00100000:1.0:1787784499.967017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:1.0:1787784499.967028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634684672:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784499.967120:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634684672:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784499.967128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00080000:3.0:1787784499.967671:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784499.967815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684544 00000100:00100000:0.0:1787784499.967821:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684544 00000100:00100000:0.0:1787784499.967866:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 287 00000100:00100000:0.0:1787784499.967875:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634684544:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784499.967922:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634684544:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 49us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784499.967929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 287 00000100:00100000:2.0:1787784499.991819:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784499.991895:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784499.992037:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684800 00000100:00100000:3.0:1787784499.992052:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684800 00000100:00100000:3.0:1787784499.992163:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1787784499.992175:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2361:x1874627634684800:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1787784499.992215:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bab41 00000100:00080000:3.0:1787784499.992225:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431bf3c1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784499.992295:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1787784499.992459:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784499.992506:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784499.992692:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+2:2361:x1874627634684800:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 517us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784499.992702:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:1.0:1787784499.994229:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634684928 00000100:00100000:1.0:1787784499.994243:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634684928 00000100:00080000:0.0:1787784499.994411:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784499.994503:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:1.0:1787784499.994514:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634684928:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784499.994612:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2364:x1874627634684928:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 100us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784499.994619:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 133 00010000:00010000:1.0:1787784500.853263:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787784501.174190:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:1.0:1787784501.174203:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431bf3c4800/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:0.0:1787784501.174688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3c4800/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-OST0000 00000020:00000080:0.0:1787784501.174760:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf3c1000 for lustre-OST0000 00010000:00010000:0.0:1787784501.876600:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784502.071986:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643112448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784502.072077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784502.072178:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112448 00000100:00100000:3.0:1787784502.072190:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112448 00000100:00100000:3.0:1787784502.072272:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787784502.072283:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643112448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784502.072338:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784502.072428:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643112448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784502.072437:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787784502.072465:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784502.072519:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643112448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784502.903526:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784503.606121:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643112704:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.606246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784503.606324:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643112960:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.606356:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643113216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.606398:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784503.606419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784503.606454:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784503.606454:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787784503.606464:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643112832:0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.606467:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643112576:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.606495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784503.606520:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784503.606538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112704 00000100:00100000:1.0:1787784503.606547:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112704 00000100:00100000:0.0:1787784503.606551:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643113088:0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.606591:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784503.606874:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112576 00000100:00100000:0.0:1787784503.606879:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112576 00000100:00100000:3.0:1787784503.606884:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112960 00000100:00100000:3.0:1787784503.606891:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112960 00000100:00100000:0.0:1787784503.606931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787784503.606937:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113216 00000100:00100000:3.0:1787784503.606941:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113216 00000100:00100000:0.0:1787784503.606945:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643112576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784503.606977:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784503.606998:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643112960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.607011:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643112576:12345-0@lo:400:kworker.0 Request processed in 69us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784503.607019:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787784503.607049:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643112960:12345-0@lo:400:kworker.0 Request processed in 53us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784503.607057:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784503.607077:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784503.607085:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.607098:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643112576:0@lo:400:kworker.0 00000100:00100000:0.0:1787784503.607117:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643112960:0@lo:400:kworker.0 00000100:00100000:3.0:1787784503.607133:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643113216:12345-0@lo:400:kworker.0 Request processed in 48us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784503.607142:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787784503.607168:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784503.607200:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9f05680 x1874627643113216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784503.607213:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643113216:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607296:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643112832 00000100:00100000:1.0:1787784503.607300:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643112832 00000100:00100000:1.0:1787784503.607336:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113088 00000100:00100000:1.0:1787784503.607339:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113088 00000100:00100000:1.0:1787784503.607356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787784503.607363:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643112704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607431:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643112704:12345-0@lo:400:kworker.0 Request processed in 68us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784503.607439:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787784503.607454:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787784503.607460:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607488:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643112832:12345-0@lo:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784503.607494:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787784503.607507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787784503.607514:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607546:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643113088:12345-0@lo:400:kworker.0 Request processed in 33us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784503.607552:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1787784503.607572:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784503.607601:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643112832:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607612:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643112704:0@lo:400:kworker.0 00000100:00100000:1.0:1787784503.607641:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643113088:0@lo:400:kworker.0 00010000:00010000:0.0:1787784503.925417:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784504.119509:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643113344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784504.119613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784504.120049:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113344 00000100:00100000:3.0:1787784504.120061:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113344 00000100:00100000:3.0:1787784504.120140:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787784504.120153:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643113344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784504.120211:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784504.120305:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643113344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784504.120314:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787784504.120464:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431bf69b0c0 x1874627643113344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784504.120498:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643113344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787784504.949218:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784505.084494:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784505.084550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784505.084589:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784505.084652:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685184 00000100:00100000:0.0:1787784505.084666:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685184 00000100:00100000:0.0:1787784505.084756:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685312 00000100:00100000:0.0:1787784505.084760:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685312 00000100:00100000:0.0:1787784505.084786:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:0.0:1787784505.084798:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634685184:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784505.084891:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685056 00000100:00100000:3.0:1787784505.084896:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685056 00000100:00100000:0.0:1787784505.084897:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634685184:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784505.084906:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:3.0:1787784505.084928:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 289 00000100:00100000:3.0:1787784505.084935:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634685056:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784505.084943:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:0.0:1787784505.084949:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634685312:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784505.084964:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634685056:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784505.084969:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634685312:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 21us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784505.084976:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1787784505.084978:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 289 00000100:00080000:2.0:1787784505.086286:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784505.974083:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784506.996560:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784507.191916:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643113472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784507.192023:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784507.192486:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113472 00000100:00100000:3.0:1787784507.192499:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113472 00000100:00100000:3.0:1787784507.192624:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784507.192636:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643113472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784507.193051:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784507.193135:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643113472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 500us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784507.193144:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787784507.193255:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643113472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787784507.195822:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787784508.029863:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784508.731660:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643113984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.731815:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643113600:0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.742484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784508.742582:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643114112:0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.742636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784508.742704:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113600 00000100:00100000:3.0:1787784508.742714:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113600 00000100:00100000:2.0:1787784508.743044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784508.743094:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643113728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784508.743205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784508.743230:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643114240:0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.744629:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787784508.744645:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643113600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.746322:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643113600:12345-0@lo:400:kworker.0 Request processed in 1671us (3839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784508.746338:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787784508.746431:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114112 00000100:00100000:3.0:1787784508.746442:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114112 00000100:00100000:3.0:1787784508.746499:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113728 00000100:00100000:3.0:1787784508.746503:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113728 00000100:00100000:3.0:1787784508.746528:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787784508.746546:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643114112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.746606:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643114112:12345-0@lo:400:kworker.0 Request processed in 63us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784508.746613:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787784508.746628:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784508.746636:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643113728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.746669:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643113728:12345-0@lo:400:kworker.0 Request processed in 34us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784508.746675:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787784508.746696:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113984 00000100:00100000:3.0:1787784508.746700:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113984 00000100:00100000:3.0:1787784508.747216:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784508.747226:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643113984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.747340:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643113984:12345-0@lo:400:kworker.0 Request processed in 116us (4296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784508.747347:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787784508.747399:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784508.758405:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784508.758613:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643113728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784508.758637:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784508.758651:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643113856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784508.759825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784508.759903:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643113856 00000100:00100000:2.0:1787784508.759911:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643113856 00000100:00100000:2.0:1787784508.759982:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787784508.759992:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784508.760068:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643113856:12345-0@lo:400:kworker.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784508.760076:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1787784508.760099:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784508.760129:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643113856:0@lo:400:kworker.0 00000100:00100000:1.0:1787784508.776458:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643113600:0@lo:400:kworker.0 00000100:00100000:1.0:1787784508.776483:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643114112:0@lo:400:kworker.0 00000100:00100000:1.0:1787784508.776540:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643113984:0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.784001:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114240 00000100:00100000:3.0:1787784508.784020:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114240 00000100:00100000:3.0:1787784508.784119:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787784508.784131:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643114240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784508.786865:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643114240:12345-0@lo:400:kworker.0 Request processed in 2722us (28457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784508.786885:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787784508.787595:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787784508.797251:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431ba342580 x1874627643114240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784508.797300:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643114240:0@lo:400:kworker.0 00010000:00010000:0.0:1787784509.051710:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784509.237510:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784509.237540:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643114368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784509.237635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784509.237785:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114368 00000100:00100000:3.0:1787784509.237796:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114368 00000100:00100000:3.0:1787784509.237854:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787784509.237864:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643114368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784509.237910:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784509.237960:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643114368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784509.237967:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787784509.238016:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943187f9f480 x1874627643114368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784509.238036:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643114368:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787784509.558823:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784510.068527:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784510.209086:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784510.209132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784510.209183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784510.209272:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685440 00000100:00100000:3.0:1787784510.209287:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685440 00000100:00100000:3.0:1787784510.209361:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 291 00000100:00100000:3.0:1787784510.209393:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634685440:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784510.209470:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634685440:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784510.209479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 291 00000100:00100000:1.0:1787784510.213589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685696 00000100:00100000:1.0:1787784510.213603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685696 00000100:00100000:1.0:1787784510.213698:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685568 00000100:00100000:1.0:1787784510.213702:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685568 00000100:00100000:1.0:1787784510.213745:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:1.0:1787784510.213754:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634685696:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784510.213847:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634685696:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (4714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784510.213854:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:1.0:1787784510.213870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:1.0:1787784510.213875:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634685568:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784510.213902:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634685568:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 27us (4722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784510.213922:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00080000:0.0:1787784510.214485:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784511.093538:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784511.122558:0:11842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:48:29 (1787784509) 00010000:00010000:3.0:1787784512.116569:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784512.308939:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643114496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784512.309019:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784512.309650:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114496 00000100:00100000:0.0:1787784512.309667:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114496 00000100:00100000:0.0:1787784512.309738:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787784512.309744:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787784512.309749:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643114496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784512.309756:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1787784512.309788:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784512.309846:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643114496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784512.309853:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787784512.310013:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784512.310053:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643114496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784513.075739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784513.075873:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685824 00000100:00100000:2.0:1787784513.075884:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685824 00000100:00100000:2.0:1787784513.076087:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:2.0:1787784513.076111:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:10261:x1874627634685824:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784513.076132:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784513.076182:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bac0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a97b expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076250:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076264:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076277:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784513.076531:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787784513.076537:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784513.076638:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076666:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bac0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a97b expref: 7 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076683:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a97b expref: 6 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.076691:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183923800) 00010000:00010000:2.0:1787784513.076694:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784513.076697:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1e00, rc 0) 00000100:00100000:2.0:1787784513.076762:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:10261:x1874627634685824:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 654us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784513.076780:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00080000:1.0:1787784513.080751:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784513.094459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784513.094593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634685952 00000100:00100000:2.0:1787784513.094636:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634685952 00000100:00100000:2.0:1787784513.094716:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1787784513.094729:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:10262:x1874627634685952:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784513.094757:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784513.094783:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bac1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a982 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094880:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094898:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094913:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.094945:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095487:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095499:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095507:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784513.095612:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787784513.095616:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784513.095694:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095707:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095715:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095722:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095729:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784513.095733:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095741:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095756:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183923800) 00010000:00010000:2.0:1787784513.095759:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784513.095765:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095771:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bac21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095786:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095803:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095808:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095814:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784513.095817:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095823:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095830:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff943183923c00) 00010000:00010000:2.0:1787784513.095832:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784513.095835:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095841:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bac28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095880:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bac1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a982 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095895:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a982 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.095903:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943183923100) 00010000:00010000:2.0:1787784513.095905:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784513.095913:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0200, rc 0) 00000100:00100000:2.0:1787784513.095991:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10262:x1874627634685952:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1264us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784513.096000:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:3.0:1787784513.100738:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784513.100833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686208 00000100:00100000:2.0:1787784513.100859:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686208 00000100:00100000:2.0:1787784513.100946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:2.0:1787784513.100959:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10262:x1874627634686208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784513.100987:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784513.101041:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bac36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a989 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101134:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101163:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101175:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101192:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101199:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.101206:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.102485:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bac4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.102511:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bac4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.102522:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bac4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784513.102550:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787784513.104003:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104022:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104030:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104036:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784513.104041:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104049:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104068:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943183923100) 00010000:00010000:2.0:1787784513.104071:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784513.104077:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104084:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bac3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104100:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104116:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104122:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104128:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784513.104131:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104149:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104159:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff943183923f00) 00010000:00010000:2.0:1787784513.104162:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784513.104165:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.104170:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bac44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.105593:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bac36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a989 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.107820:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bac4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a989 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784513.107836:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:2.0:1787784513.107840:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784513.107913:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501400, rc 0) 00000100:00100000:2.0:1787784513.109773:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10262:x1874627634686208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 8803us (9035us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787784513.109790:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:0.0:1787784513.127791:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784513.131481:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686336 00000100:00100000:2.0:1787784513.131503:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686336 00000100:00100000:2.0:1787784513.131615:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:2.0:1787784513.131630:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10262:x1874627634686336:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787784513.131914:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10262:x1874627634686336:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 287us (4135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784513.131923:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00010000:00010000:1.0:1787784513.141035:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784513.653054:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787784513.850929:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643114624:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851005:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851050:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643115136:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851078:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851105:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784513.851111:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643115008:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851187:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643114752:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851228:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643115264:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851248:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851266:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784513.851271:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643114880:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784513.851329:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114624 00000100:00100000:1.0:1787784513.851336:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114624 00000100:00100000:1.0:1787784513.851397:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787784513.851406:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851456:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643114624:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851464:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787784513.851496:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643115136 00000100:00100000:1.0:1787784513.851501:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643115136 00000100:00100000:1.0:1787784513.851535:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114752 00000100:00100000:1.0:1787784513.851538:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114752 00000100:00100000:1.0:1787784513.851553:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643114880 00000100:00100000:1.0:1787784513.851555:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643114880 00000100:00100000:1.0:1787784513.851570:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787784513.851576:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851608:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643115136:12345-0@lo:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851614:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787784513.851626:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787784513.851633:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643114752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851675:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643114752:12345-0@lo:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851752:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787784513.851765:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787784513.851772:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643114880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851801:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643114880:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851816:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787784513.851835:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643115008 00000100:00100000:1.0:1787784513.851838:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643115008 00000100:00100000:1.0:1787784513.851863:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643115264 00000100:00100000:1.0:1787784513.851866:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643115264 00000100:00100000:1.0:1787784513.851887:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784513.851893:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643115008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851939:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643115008:12345-0@lo:400:kworker.0 Request processed in 45us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851945:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787784513.851956:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787784513.851961:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643115264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.851989:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643115264:12345-0@lo:400:kworker.0 Request processed in 28us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784513.851994:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787784513.852028:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784513.852033:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784513.852069:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643114880:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.852082:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643114752:0@lo:400:kworker.0 00010000:00080000:1.0:1787784513.852092:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b9f03c00 x1874627643115264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787784529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784513.852102:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643115264:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.852145:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643115008:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.852154:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643114624:0@lo:400:kworker.0 00000100:00100000:1.0:1787784513.852172:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643115136:0@lo:400:kworker.0 00010000:00010000:0.0:1787784514.168514:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784514.356828:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784514.356851:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643115392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784514.357513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784514.357644:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643115392 00000100:00100000:3.0:1787784514.357652:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643115392 00000100:00100000:3.0:1787784514.357897:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784514.358005:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643115392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784514.358045:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784514.359008:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643115392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1005us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784514.359017:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787784514.366678:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943187f9da40 x1874627643115392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784514.366718:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643115392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787784515.189855:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784515.323609:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784515.323658:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784515.323690:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784515.323718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686464 00000100:00100000:3.0:1787784515.323728:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686464 00000100:00100000:3.0:1787784515.323774:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 293 00000100:00100000:3.0:1787784515.323785:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634686464:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784515.323865:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634686464:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.323873:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 293 00000100:00100000:3.0:1787784515.323910:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686592 00000100:00100000:3.0:1787784515.323914:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686592 00000100:00100000:3.0:1787784515.323950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686720 00000100:00100000:3.0:1787784515.323954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686720 00000100:00100000:3.0:1787784515.323984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:3.0:1787784515.323991:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634686592:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784515.324025:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634686592:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.324051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:3.0:1787784515.324064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:3.0:1787784515.324070:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634686720:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784515.324095:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634686720:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784515.324101:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00080000:3.0:1787784515.324259:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784515.576853:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784515.577330:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634686848 00000100:00100000:0.0:1787784515.577342:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634686848 00000100:00100000:0.0:1787784515.577592:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:0.0:1787784515.577604:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10305:x1874627634686848:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784515.577628:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784515.577652:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bac59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a990 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577794:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577809:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577820:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577836:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577842:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.577848:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578125:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578134:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578151:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578157:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784515.578161:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578169:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578182:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183923800) 00010000:00010000:0.0:1787784515.578185:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784515.578190:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578196:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bac60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578209:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578215:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578220:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578224:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784515.578227:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578241:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578249:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff943183fdce00) 00010000:00010000:0.0:1787784515.578251:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784515.578255:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578260:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bac67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578296:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bac59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a990 expref: 10 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578306:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183923800) 00010000:00010000:0.0:1787784515.578308:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784515.578312:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bac59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a990 expref: 10 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.578322:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89a00, rc 0) 00000100:00100000:0.0:1787784515.582947:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10305:x1874627634686848:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 5328us (6090us total) trans 0 rc 301/301 00000100:00100000:0.0:1787784515.582962:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784515.589061:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.589149:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687104 00000100:00100000:1.0:1787784515.589159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687104 00000100:00100000:1.0:1787784515.589221:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784515.589232:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10305:x1874627634687104:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:1.0:1787784515.589293:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784515.589320:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bac13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a97b expref: 9 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589339:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183923800) 00010000:00010000:1.0:1787784515.589351:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784515.589710:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589725:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589736:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589749:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589756:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.589771:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784515.590857:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787784515.590874:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590884:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590891:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590897:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784515.590901:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590908:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590921:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784515.590923:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784515.590929:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.590935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784515.590953:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e77f307 reply state 00000000330021b3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784515.590973:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784515.591104:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:10305:x1874627634687104:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 1869us (2049us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787784515.591113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00010000:00010000:0.0:1787784515.594210:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594227:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594249:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594255:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784515.594259:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594267:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594284:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94318a498500) 00010000:00010000:0.0:1787784515.594286:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784515.594291:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784515.594296:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac75 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784515.686712:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.686811:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687232 00000100:00100000:1.0:1787784515.686820:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687232 00000100:00100000:1.0:1787784515.686883:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:1.0:1787784515.686893:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:10313:x1874627634687232:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:1.0:1787784515.686919:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784515.686944:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a997 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687015:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687032:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687044:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784515.687126:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787784515.687131:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784515.687186:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687216:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a997 expref: 11 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687257:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a997 expref: 10 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.687265:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784515.687269:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784515.687272:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784515.687345:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:10313:x1874627634687232:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 453us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.687353:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1787784515.772821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.775696:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687360 00000100:00100000:1.0:1787784515.775711:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687360 00000100:00100000:1.0:1787784515.775851:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:1.0:1787784515.775863:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:10319:x1874627634687360:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784515.775887:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784515.775911:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a99e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.775983:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.775998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776011:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776026:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776050:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776057:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776190:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776198:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776204:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784515.776237:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787784515.776241:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784515.776279:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776290:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776297:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776303:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776308:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784515.776312:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776326:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776338:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784515.776341:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784515.776346:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776352:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bac91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776398:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776404:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776409:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776414:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784515.776416:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776421:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776428:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff94318a498b00) 00010000:00010000:1.0:1787784515.776430:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784515.776433:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776449:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bac98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776499:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bac8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a99e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776514:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a99e expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.776522:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784515.776524:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784515.776527:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1c00, rc 0) 00000100:00100000:1.0:1787784515.776594:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:10319:x1874627634687360:12345-192.168.202.59@tcp:101:bash.0 Request processed in 732us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.776602:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:0.0:1787784515.784415:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784515.784621:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687616 00000100:00100000:3.0:1787784515.784631:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687616 00000100:00100000:3.0:1787784515.784689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:3.0:1787784515.784700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:10319:x1874627634687616:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784515.784722:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784515.784743:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20baca6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9a5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784906:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784921:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784934:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784967:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784976:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.784983:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784515.790102:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787784515.790579:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790600:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790615:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790665:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790672:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790679:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790700:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784515.790705:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790712:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790726:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784515.790728:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784515.790734:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bacad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784515.790753:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c56fd098 reply state 00000000dda65674 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784515.790763:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784515.790806:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20baca6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790821:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.790828:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:2.0:1787784515.790830:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784515.790832:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500600, rc 0) 00000100:00100000:2.0:1787784515.790923:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10319:x1874627634687616:12345-192.168.202.59@tcp:101:bash.0 Request processed in 6225us (6518us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787784515.790937:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00010000:00010000:3.0:1787784515.796070:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796091:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796100:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796106:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784515.796112:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796129:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796149:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94319746ed00) 00010000:00010000:3.0:1787784515.796153:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784515.796158:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784515.796165:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bacb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784515.798947:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.802918:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687744 00000100:00100000:1.0:1787784515.802933:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687744 00000100:00100000:1.0:1787784515.803001:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1787784515.803010:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874627634687744:12345-192.168.202.59@tcp:8:bash.0 00010000:00080000:1.0:1787784515.803045:0:8198:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1787784515.803078:0:8198:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20bacc9 00002000:00100000:1.0:1787784515.803092:0:8198:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f9a4fd2c-0c67-4cd1-a267-69f5c190cff9/ffff9431bf3af000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787784515.803105:0:8198:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1787784515.803458:0:8198:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787784515.803501:0:8198:0:(import.c:65:import_set_state_nolock()) ffff9431bf3ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784515.803599:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634687744:12345-192.168.202.59@tcp:8:bash.0 Request processed in 588us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.803608:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784515.806270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.807672:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634687872 00000100:00100000:1.0:1787784515.807688:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634687872 00000100:00100000:1.0:1787784515.807779:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1787784515.807791:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:0:x1874627634687872:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784515.807810:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784515.807836:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9ac expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787784515.807864:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784515.807885:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787784515.807889:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784515.807899:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.807920:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.807932:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0600, rc 0) 00000100:00080000:3.0:1787784515.808048:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784515.808488:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:0:x1874627634687872:12345-192.168.202.59@tcp:101:bash.0 Request processed in 697us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.808498:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784515.828716:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.829524:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634688000 00000100:00100000:1.0:1787784515.829536:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634688000 00000100:00100000:1.0:1787784515.829597:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1787784515.829625:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10319:x1874627634688000:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784515.829647:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784515.829674:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9b3 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.829705:0:8198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.829715:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784515.829720:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784515.829726:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 8 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.829757:0:8198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.829771:0:8198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784515.829786:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643115520:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784515.829880:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186804600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784515.834604:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643115520:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784515.834650:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 8 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.834700:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784515.834778:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:10319:x1874627634688000:12345-192.168.202.59@tcp:101:bash.0 Request processed in 5154us (6070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.834788:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784515.835100:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784515.835551:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634688128 00000100:00100000:1.0:1787784515.835561:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634688128 00010000:00010000:1.0:1787784515.835603:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784515.835643:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:1.0:1787784515.835653:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634688128:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784515.835772:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784515.835799:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.835814:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.835839:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bacd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9ac expref: 8 pid: 6677 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.835858:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784515.835862:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784515.835870:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.835891:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784515.835927:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784515.835941:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643115648:192.168.202.59@tcp:105: 00000100:00100000:1.0:1787784515.836029:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186804600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784515.854690:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784515.856007:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634688384 00000100:00100000:2.0:1787784515.856023:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634688384 00000100:00100000:2.0:1787784515.856104:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1787784515.856126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10319:x1874627634688384:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:2.0:1787784515.856594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10319:x1874627634688384:12345-192.168.202.59@tcp:35:bash.0 Request processed in 478us (1912us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787784515.856602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784515.857099:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f02580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643115648:192.168.202.59@tcp:105: 00010000:00010000:1.0:1787784515.857132:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784515.857169:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634688128:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 21517us (22070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784515.857179:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:0.0:1787784515.961312:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784515.961639:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634688640 00000100:00100000:2.0:1787784515.961650:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634688640 00000100:00100000:2.0:1787784515.961720:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1787784515.961731:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10329:x1874627634688640:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784515.961756:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784515.961778:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bacde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9ba expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784515.961898:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787784515.962032:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bacde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9ba expref: 16 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.962048:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:2.0:1787784515.962051:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784515.962057:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bacde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9ba expref: 16 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784515.962089:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501a00, rc 0) 00000100:00100000:2.0:1787784515.962164:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10329:x1874627634688640:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 434us (864us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787784515.962172:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1787784515.966001:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784515.966128:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634688896 00000100:00100000:2.0:1787784515.966140:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634688896 00000100:00100000:2.0:1787784515.966198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1787784515.966208:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10329:x1874627634688896:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784515.966557:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:10329:x1874627634688896:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 350us (565us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787784515.966566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784516.110546:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784516.112031:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689024 00000100:00100000:1.0:1787784516.112045:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689024 00000100:00100000:1.0:1787784516.112129:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1787784516.112141:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:10335:x1874627634689024:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784516.112167:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784516.112188:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bacec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9c1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114423:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114447:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114484:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784516.114548:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787784516.114552:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784516.114573:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114605:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bacec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114627:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c1 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.114635:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784516.114638:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784516.114641:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784516.114719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:10335:x1874627634689024:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 2580us (4270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784516.114727:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1787784516.118900:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784516.119073:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689280 00000100:00100000:2.0:1787784516.119093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689280 00000100:00100000:2.0:1787784516.119230:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:2.0:1787784516.119253:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:10335:x1874627634689280:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784516.119275:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784516.119295:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bacfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9c8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.120362:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bad01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.120428:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bad01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.120443:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bad01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784516.120491:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787784516.120674:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bacfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c8 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.120697:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bad01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c8 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.120706:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:2.0:1787784516.120709:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784516.120713:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500200, rc 0) 00000100:00100000:2.0:1787784516.120793:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10335:x1874627634689280:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1552us (1910us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787784516.120802:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1787784516.125306:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784516.125494:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689408 00000100:00100000:1.0:1787784516.125508:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689408 00000100:00100000:3.0:1787784516.125511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784516.125539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689664 00000100:00100000:3.0:1787784516.125543:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689664 00000100:00100000:3.0:1787784516.125584:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:1.0:1787784516.125584:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1787784516.125594:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10335:x1874627634689664:12345-192.168.202.59@tcp:101:lfs.0 00000100:00100000:1.0:1787784516.125594:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:2363:x1874627634689408:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784516.125628:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784516.125665:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bad01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c8 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.125703:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784516.125716:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:1.0:1787784516.125723:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784516.125727:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9cf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784516.125806:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:2363:x1874627634689408:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 213us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784516.125817:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00010000:00010000:3.0:1787784516.125853:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.125871:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.125884:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784516.125898:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787784516.126595:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9cf expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.127092:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9cf expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.127102:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:3.0:1787784516.127135:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787784516.127140:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610000, rc 0) 00000100:00100000:3.0:1787784516.127220:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10335:x1874627634689664:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1626us (1707us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787784516.127229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1787784516.132079:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784516.132151:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689792 00000100:00100000:2.0:1787784516.132167:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689792 00000100:00100000:2.0:1787784516.132260:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1787784516.132272:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634689792:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:2.0:1787784516.132317:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.132339:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.132349:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784516.132354:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784516.132359:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.132435:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.132450:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 7 pid: 8198 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784516.132474:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874627643115776:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784516.132570:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784516.136441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.136548:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634689920 00000100:00100000:0.0:1787784516.136564:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634689920 00002000:00100000:0.0:1787784516.136662:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff943187f9fc00 x1874627634689920/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:397/0 lens 504/0 e 0 to 0 dl 1787784527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784516.136675:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943187f9fc00 with x1874627634689920 ext(0->12) 00010000:00010000:0.0:1787784516.136686:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 8 pid: 8198 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.136706:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 8 pid: 8198 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784516.136715:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff943187f9fc00 00000100:00100000:0.0:1787784516.136762:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1787784516.136774:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634689920:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:2.0:1787784516.138458:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874627643115776:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784516.138491:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787784516.188959:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000100:00100000:0.0:1787784516.190032:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634689920:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 53252us (53666us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787784516.190047:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:0.0:1787784516.190063:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff943187f9fc00 x1874627634689920/t4294967299(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:397/0 lens 504/448 e 0 to 0 dl 1787784527 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784516.190075:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943187f9fc00 with x1874627634689920 ext(0->12) 00010000:00010000:0.0:1787784516.190088:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.190214:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784516.190224:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff943187f9fc00 00000100:00100000:0.0:1787784516.194092:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784516.194318:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634690048 00000100:00100000:3.0:1787784516.194329:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634690048 00010000:00010000:3.0:1787784516.194738:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784516.194847:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784516.194860:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634690048:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784516.194880:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787784516.194902:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787784516.194905:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787784516 00002000:00010000:3.0:1787784516.194909:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787784516 00002000:00010000:3.0:1787784516.194911:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787784516 00010000:00010000:3.0:1787784516.194918:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.194934:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.194964:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036e5a8e5/0xffb8d925c20bacd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849a9b3 expref: 9 pid: 8198 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.195002:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1787784516.195007:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784516.195013:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.195024:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.195063:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784516.195149:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634690048:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 292us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784516.195157:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00010000:00010000:2.0:1787784516.195230:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195242:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195270:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195278:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195299:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195307:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784516.195311:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195320:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195335:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.195355:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bad24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784516.195578:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634689792:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 63307us (63512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784516.195587:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:1.0:1787784516.198475:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784516.198577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634690304 00000100:00100000:2.0:1787784516.198588:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634690304 00000100:00100000:2.0:1787784516.198643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784516.198653:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10335:x1874627634690304:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:2.0:1787784516.198745:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9cf expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784516.199032:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787784516.199081:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00010000:00010000:1.0:1787784516.213514:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787784516.216006:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787784516.218246:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.218276:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.218286:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.218333:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.218496:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 24 pid: 5831 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784516.218514:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431918d7c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643115904:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784516.218890:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784516.223004:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431918d7c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643115904:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784516.223040:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784516.223615:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784516.224105:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634690432 00000100:00100000:1.0:1787784516.224127:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634690432 00010000:00010000:1.0:1787784516.224168:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 25 pid: 5831 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784516.224214:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784516.224226:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:2363:x1874627634690432:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784516.224243:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784516.224251:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 25 pid: 5831 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224265:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 25 pid: 5831 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224310:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bacbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9a5 expref: 25 pid: 5831 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224329:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:1.0:1787784516.224334:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224344:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224353:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.224434:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784516.224489:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:2363:x1874627634690432:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 266us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784516.224496:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00010000:00010000:3.0:1787784516.225502:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.225515:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784516.225796:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787784516.233630:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787784516.233992:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643116032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784516.244811:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784516.244895:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784516.244924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643116032 00000100:00100000:3.0:1787784516.244944:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643116032 00000100:00100000:3.0:1787784516.245132:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784516.245145:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643116032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787784516.245277:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643116032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784516.245284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784516.245473:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643116032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784516.246200:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787784516.246287:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643116160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784516.246330:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784516.246350:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784516.246536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643116160 00000100:00100000:3.0:1787784516.246542:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643116160 00000100:00100000:3.0:1787784516.246580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784516.246588:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643116160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787784516.246747:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874627643116160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (416us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787784516.246754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784516.247567:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643116160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784516.247644:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00080000:1.0:1787784516.247941:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787784516.248027:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248039:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248048:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248054:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784516.248059:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248067:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248317:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:3.0:1787784516.248322:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787784516.248327:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.248334:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bad2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784516.248956:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787784516.249641:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787784516.250250:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331076882608ns, next at 332076288497ns, rc = 0 00000001:00080000:3.0:1787784516.250269:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787784516.250333:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923f00) 00010000:00010000:3.0:1787784516.250337:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787784516.250358:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9cf expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784516.250684:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10335:x1874627634690304:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 52032us (52220us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787784516.250693:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000020:00080000:3.0:1787784516.250698:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787784516.261307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784516.261486:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634690560 00000100:00100000:1.0:1787784516.261498:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634690560 00000100:00100000:1.0:1787784516.261555:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:1.0:1787784516.261565:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10335:x1874627634690560:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784516.261593:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784516.261617:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bad32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.261691:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bad32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9d6 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.261722:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bad32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9d6 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784516.261744:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:1.0:1787784516.261747:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784516.261751:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784516.261826:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:10335:x1874627634690560:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 262us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784516.261834:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:1.0:1787784516.274230:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784516.274541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634690816 00000100:00100000:3.0:1787784516.274551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634690816 00000100:00100000:3.0:1787784516.274616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1787784516.274627:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac782450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:10335:x1874627634690816:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784516.274922:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac782450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10335:x1874627634690816:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 296us (703us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787784516.274930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1787784516.437055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.437273:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634691072 00000100:00100000:0.0:1787784516.437282:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634691072 00000100:00100000:0.0:1787784516.437346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1787784516.437357:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10345:x1874627634691072:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784516.437480:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784516.437502:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bad39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784516.437766:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787784516.437988:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bad39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9dd expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.438012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:0.0:1787784516.438016:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784516.438023:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bad39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9dd expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.439094:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784516.439707:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10345:x1874627634691072:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 2345us (2659us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787784516.439718:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:1.0:1787784516.445956:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784516.446042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634691200 00000100:00100000:3.0:1787784516.446052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634691200 00000100:00100000:3.0:1787784516.446122:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1787784516.446133:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10345:x1874627634691200:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1787784516.446212:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.446229:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.446256:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.446272:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.446280:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.446286:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447003:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447015:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447023:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784516.447069:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447083:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447090:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447097:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447124:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784516.447128:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447135:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447148:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784516.447151:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784516.447156:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447162:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bad47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447175:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447181:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447186:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447191:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784516.447193:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447199:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447217:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94319746ed00) 00010000:00010000:3.0:1787784516.447219:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784516.447222:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447228:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bad4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447242:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447248:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447254:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447258:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784516.447261:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447267:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447274:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:3.0:1787784516.447277:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784516.447280:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784516.447286:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bad55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784516.447400:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10345:x1874627634691200:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1266us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784516.447409:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:1.0:1787784516.451432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784516.451523:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634691456 00000100:00100000:3.0:1787784516.451533:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634691456 00000100:00100000:3.0:1787784516.451584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784516.451593:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10345:x1874627634691456:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784516.452193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:10345:x1874627634691456:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 600us (769us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787784516.452202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000001:00080000:1.0:1787784516.503138:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:1.0:1787784516.503162:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967324 is committed 00000020:00080000:1.0:1787784516.503171:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431b9efdf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787784516.503176:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318659b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94318691f9c0 00000020:00080000:1.0:1787784516.503180:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318659b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431bedf9000 00000001:00080000:1.0:1787784516.503219:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:1.0:1787784516.503225:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787784516.503291:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787784516.503442:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787784516.503989:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431918d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643116288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787784516.504060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784516.505535:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643116288 00000100:00100000:0.0:1787784516.505547:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643116288 00000100:00100000:0.0:1787784516.505626:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787784516.505636:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643116288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787784516.505675:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787784516.505712:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f6d44, atime: 0x6a8f6d44, ctime: 0x6a8f6d44, blocks: 0x1 00010000:00010000:0.0:1787784516.505720:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.505738:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787784516.505743:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784516.505748:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.505762:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.505792:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.505799:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.505827:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784516.506451:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643116288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 814us (2389us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787784516.506462:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1787784516.506518:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9431918d43c0/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787784516.506525:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431918d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643116288:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787784516.506668:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784516.506677:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.506687:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784516.506692:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.506703:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.506734:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.506742:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bad5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.506763:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784516.506766:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784516.506768:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784516.518509:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.518638:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634691712 00000100:00100000:0.0:1787784516.518648:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634691712 00000100:00100000:0.0:1787784516.518710:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:0.0:1787784516.518720:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10348:x1874627634691712:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784516.518744:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784516.518765:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bad63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9e4 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518841:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518857:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518885:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518901:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518908:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.518916:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519304:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519315:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519322:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784516.519332:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787784516.519472:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519481:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519487:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519492:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784516.519503:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519512:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519524:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784516.519528:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784516.519532:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519539:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bad6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519554:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519560:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519566:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519572:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784516.519575:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519581:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519589:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdcf00) 00010000:00010000:0.0:1787784516.519591:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784516.519600:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519619:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bad71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519663:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bad63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 16 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519676:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 15 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.519684:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784516.519686:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784516.519688:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89000, rc 0) 00000100:00100000:0.0:1787784516.519753:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10348:x1874627634691712:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1033us (1256us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787784516.519761:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:1.0:1787784516.523788:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.523867:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634691840 00000100:00100000:0.0:1787784516.523877:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634691840 00000100:00100000:0.0:1787784516.523937:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1787784516.523947:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10348:x1874627634691840:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784516.524019:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524037:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524048:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524095:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524102:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524120:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524128:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784516.524132:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524139:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524151:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784516.524154:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784516.524158:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784516.524164:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bad86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784516.524260:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10348:x1874627634691840:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 314us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784516.524268:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:1.0:1787784516.527959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.528044:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634692096 00000100:00100000:0.0:1787784516.528053:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634692096 00000100:00100000:0.0:1787784516.528117:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784516.528142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10348:x1874627634692096:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1787784516.528415:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:10348:x1874627634692096:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 274us (464us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787784516.528424:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1787784516.904600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784516.905332:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634692352 00000100:00100000:2.0:1787784516.905343:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634692352 00000100:00100000:2.0:1787784516.905496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:2.0:1787784516.905507:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:10379:x1874627634692352:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1787784516.905533:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784516.905555:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bad8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.906178:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bad94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.906197:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bad94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.906209:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bad94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784516.906221:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787784516.906429:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bad8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9eb expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.906450:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bad94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.906458:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784516.906461:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784516.906464:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501a00, rc 0) 00000100:00100000:2.0:1787784516.906786:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10379:x1874627634692352:12345-192.168.202.59@tcp:101:cat.0 Request processed in 1280us (2195us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787784516.906795:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1787784516.912149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784516.912819:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634692480 00000100:00100000:2.0:1787784516.912830:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634692480 00000100:00100000:2.0:1787784516.912899:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1787784516.912910:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2362:x1874627634692480:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784516.912926:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784516.912951:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bad94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784516.912969:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784516.912975:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784516.913036:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:2362:x1874627634692480:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 129us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784516.913044:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:1.0:1787784516.926242:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784516.926354:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634692736 00000100:00100000:0.0:1787784516.926491:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634692736 00000100:00100000:2.0:1787784516.926675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784516.926686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:10379:x1874627634692736:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:2.0:1787784516.927011:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10379:x1874627634692736:12345-192.168.202.59@tcp:35:cat.0 Request processed in 326us (777us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787784516.927019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1787784517.046230:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784517.046342:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634692992 00000100:00100000:3.0:1787784517.046352:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634692992 00000100:00100000:3.0:1787784517.046469:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1787784517.046480:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10385:x1874627634692992:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:3.0:1787784517.046505:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784517.046509:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787784517.046534:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bacf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9c1 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046554:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784517.046559:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784517.046574:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bada2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9f2 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046695:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046709:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 18 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046719:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046756:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 18 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.046771:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 18 pid: 8617 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784517.046786:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643116416:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784517.046896:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4417d80 going to sleep for 11 seconds 00000100:00080000:1.0:1787784517.047361:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784517.050661:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed870c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643116416:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784517.050694:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784517.051342:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784517.060981:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634693120 00000100:00100000:0.0:1787784517.060999:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634693120 00010000:00010000:0.0:1787784517.061080:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 19 pid: 8617 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784517.061131:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1787784517.061142:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:2363:x1874627634693120:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784517.061163:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784517.061170:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 19 pid: 8617 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061184:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 19 pid: 8617 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061208:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bad78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9e4 expref: 19 pid: 8617 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061226:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784517.061232:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061259:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061267:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.061304:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784517.062051:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.062062:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784517.062081:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787784517.062281:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bada2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 20 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.062297:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 19 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.062305:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:3.0:1787784517.062307:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787784517.062310:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611c00, rc 0) 00000100:00100000:3.0:1787784517.062355:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10385:x1874627634692992:12345-192.168.202.59@tcp:101:dd.0 Request processed in 15878us (16136us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787784517.062393:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784517.063938:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634693120:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 263us (10063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784517.063952:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:1.0:1787784517.074162:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784517.074284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634693376 00000100:00100000:3.0:1787784517.074296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634693376 00000100:00100000:3.0:1787784517.074411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1787784517.074425:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10385:x1874627634693376:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:3.0:1787784517.080618:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.080646:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.081798:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784517.090028:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787784517.093324:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006a1900f reply state 000000003deb7600 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784517.093346:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784517.093558:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10385:x1874627634693376:12345-192.168.202.59@tcp:36:dd.0 Request processed in 19132us (19401us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787784517.093569:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000020:00080000:2.0:1787784517.093575:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784517.102559:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102581:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102591:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102598:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784517.102614:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102622:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102640:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784517.102643:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784517.102656:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784517.102687:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20badb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.236749:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784517.430386:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784517.430412:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643116544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784517.430490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784517.430654:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643116544 00000100:00100000:1.0:1787784517.430664:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643116544 00000100:00100000:1.0:1787784517.430736:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787784517.430747:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643116544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784517.430782:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784517.430834:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643116544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784517.430842:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787784517.430892:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba341680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643116544:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784517.431075:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784517.570805:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784517.571336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634693504 00000100:00100000:2.0:1787784517.571348:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634693504 00000100:00100000:2.0:1787784517.571574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:2.0:1787784517.571584:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10399:x1874627634693504:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:2.0:1787784517.571809:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784517.571833:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20badbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849a9f9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571906:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571931:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571965:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571972:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.571979:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.572343:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.572572:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.572582:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.573281:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.573300:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 21 pid: 8618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784517.573315:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643116672:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784517.573585:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431909b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784517.577234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784517.577580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634693760 00000100:00100000:3.0:1787784517.577591:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634693760 00000100:00100000:3.0:1787784517.577684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1787784517.577696:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:5607:x1874627634693760:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787784517.578111:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:5607:x1874627634693760:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 417us (885us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787784517.578120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784517.581477:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643116672:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784517.581513:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784517.581803:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784517.581897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634693888 00000100:00100000:3.0:1787784517.581905:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634693888 00010000:00010000:3.0:1787784517.581947:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 23 pid: 8618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784517.581991:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1787784517.582000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:2363:x1874627634693888:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784517.582016:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784517.582023:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 23 pid: 8618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582036:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 23 pid: 8618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582058:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bada9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849a9f2 expref: 23 pid: 8618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582073:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:3.0:1787784517.582078:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582089:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582107:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.582234:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784517.582290:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2363:x1874627634693888:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 291us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784517.582297:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00010000:00010000:1.0:1787784517.583895:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.583909:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784517.583961:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787784517.583965:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784517.584024:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584040:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584050:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584057:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584064:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584069:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784517.584072:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584080:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584118:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784517.584122:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784517.584127:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584134:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20badc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584147:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584154:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584164:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584170:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784517.584173:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584179:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584186:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183923e00) 00010000:00010000:1.0:1787784517.584188:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784517.584191:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584196:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20badcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584236:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20badbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f9 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584249:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f9 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784517.584256:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:1.0:1787784517.584259:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784517.584261:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501200, rc 0) 00000100:00100000:1.0:1787784517.584478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10399:x1874627634693504:12345-192.168.202.59@tcp:101:stat.0 Request processed in 12894us (13832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784517.584496:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1787784517.679944:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784517.680258:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634694144 00000100:00100000:3.0:1787784517.680273:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634694144 00000100:00100000:3.0:1787784517.680349:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1787784517.680405:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10405:x1874627634694144:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:3.0:1787784517.680487:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784517.680523:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20badd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9f9 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.680543:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:3.0:1787784517.680560:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784517.681157:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.681192:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.681203:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784517.681263:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787784517.681288:0:8618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbdb6b4d reply state 00000000b33d0d67 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784517.681297:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784517.681462:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10405:x1874627634694144:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 1101us (1526us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787784517.681471:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000020:00080000:2.0:1787784517.681477:0:8618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787784517.690027:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690046:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690055:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690061:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784517.690066:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690074:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690117:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:3.0:1787784517.690120:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784517.690126:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784517.690133:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20badda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784517.935202:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784517.935311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634694272 00000100:00100000:2.0:1787784517.935321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634694272 00000100:00100000:2.0:1787784517.935411:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:2.0:1787784517.935423:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:10419:x1874627634694272:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:2.0:1787784517.935448:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784517.935468:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bade1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa00 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935568:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935583:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935594:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935626:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935634:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.935640:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936015:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936024:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936031:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784517.936068:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787784517.936073:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784517.936108:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936120:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936127:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936133:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936148:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936154:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784517.936158:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936165:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936179:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784517.936183:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784517.936187:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936193:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bade8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936204:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936210:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936215:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936220:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784517.936222:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936239:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183923d00) 00010000:00010000:2.0:1787784517.936250:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784517.936253:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936258:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20badef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936292:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bade1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936306:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784517.936311:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784517.936314:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784517.936316:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:2.0:1787784517.936423:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10419:x1874627634694272:12345-192.168.202.59@tcp:101:stat.0 Request processed in 1002us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784517.936432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1787784518.087733:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784518.087831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634694528 00000100:00100000:1.0:1787784518.087842:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634694528 00000100:00100000:1.0:1787784518.087905:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1787784518.087916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10429:x1874627634694528:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784518.087937:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784518.087958:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20badfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa07 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784518.088224:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787784518.088442:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20badfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa07 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784518.088456:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784518.088459:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784518.088464:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20badfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa07 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784518.088478:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784518.088537:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:10429:x1874627634694528:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 624us (815us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787784518.088544:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1787784518.093003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784518.093083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634694784 00000100:00100000:3.0:1787784518.093104:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634694784 00000100:00100000:3.0:1787784518.093166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1787784518.093177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:10429:x1874627634694784:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1787784518.096494:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:10429:x1874627634694784:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 3306us (3490us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787784518.096508:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784518.239458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.239614:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695040 00000100:00100000:0.0:1787784518.239624:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695040 00000100:00100000:0.0:1787784518.239697:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:0.0:1787784518.239709:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:10435:x1874627634695040:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784518.239739:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784518.239762:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa0e expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.239889:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.239905:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.239936:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.239971:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.239984:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 26 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.239998:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431918d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643116800:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784518.240124:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784518.251290:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784518.251397:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695168 00000100:00100000:2.0:1787784518.251408:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695168 00010000:00010000:2.0:1787784518.251453:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 27 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784518.251516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1787784518.251527:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:2362:x1874627634695168:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784518.251543:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784518.251551:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 27 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.251564:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 27 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.251592:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784518.251597:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.251608:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.251616:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.251634:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784518.251705:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:2362:x1874627634695168:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 179us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784518.251713:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00010000:00010000:0.0:1787784518.252583:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20badf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa00 expref: 26 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.252614:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431918d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643116800:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784518.252648:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.252658:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.252664:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784518.252683:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787784518.252985:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 27 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.253032:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 26 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.253041:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.253044:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787784518.253047:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784518.253160:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10435:x1874627634695040:12345-192.168.202.59@tcp:101:bash.0 Request processed in 13454us (13715us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787784518.253169:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1787784518.262330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.262629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695424 00000100:00100000:0.0:1787784518.262647:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695424 00000100:00100000:0.0:1787784518.262701:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:0.0:1787784518.262710:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10435:x1874627634695424:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:0.0:1787784518.263156:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.263176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.263188:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784518.263249:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787784518.263275:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e567c092 reply state 000000008a693c4b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.263284:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784518.263519:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10435:x1874627634695424:12345-192.168.202.59@tcp:36:bash.0 Request processed in 808us (1196us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787784518.263527:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000020:00080000:0.0:1787784518.263532:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784518.271155:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271174:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271182:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271188:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.271193:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271202:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271220:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.271223:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.271229:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.271235:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.272540:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784518.276453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.276601:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695552 00000100:00100000:0.0:1787784518.276628:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695552 00000100:00100000:0.0:1787784518.276708:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:0.0:1787784518.276720:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:10435:x1874627634695552:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784518.276760:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784518.276782:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa15 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.276868:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.276884:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 29 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.276893:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.276926:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 29 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.276940:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 29 pid: 8618 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.276953:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431918d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643116928:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784518.277041:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784518.284548:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784518.284667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695680 00000100:00100000:2.0:1787784518.284678:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695680 00010000:00010000:2.0:1787784518.284726:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 30 pid: 8618 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784518.284785:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1787784518.284795:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:2362:x1874627634695680:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784518.284810:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784518.284817:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 30 pid: 8618 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.284831:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 30 pid: 8618 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.284854:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784518.284859:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.284868:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.284876:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.284896:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784518.284953:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:2362:x1874627634695680:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 159us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784518.284961:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00010000:00010000:0.0:1787784518.285851:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa0e expref: 29 pid: 8618 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.285872:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431918d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643116928:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784518.285900:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.285926:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.285931:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784518.285982:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787784518.285989:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784518.286023:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.286053:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa15 expref: 29 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.286066:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa15 expref: 28 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.286074:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.286076:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784518.286079:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89e00, rc 0) 00000100:00100000:0.0:1787784518.286142:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:10435:x1874627634695552:12345-192.168.202.59@tcp:101:bash.0 Request processed in 9423us (9700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784518.286149:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:1.0:1787784518.307875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784518.308945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634695936 00000100:00100000:2.0:1787784518.308959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634695936 00000100:00100000:2.0:1787784518.309031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1787784518.309042:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac781c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:10435:x1874627634695936:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:2.0:1787784518.309442:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac781c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10435:x1874627634695936:12345-192.168.202.59@tcp:35:bash.0 Request processed in 401us (1576us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787784518.309452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784518.538904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.539170:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634696192 00000100:00100000:0.0:1787784518.539180:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634696192 00000100:00100000:0.0:1787784518.539249:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:0.0:1787784518.539258:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10445:x1874627634696192:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784518.539283:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784518.539321:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa1c expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784518.539693:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787784518.539859:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa1c expref: 31 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.539875:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:0.0:1787784518.539878:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784518.539883:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa1c expref: 31 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.539899:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784518.539958:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10445:x1874627634696192:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 700us (1063us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787784518.539966:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:3.0:1787784518.543686:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.544121:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634696320 00000100:00100000:0.0:1787784518.544132:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634696320 00000100:00100000:0.0:1787784518.544194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1787784518.544205:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10445:x1874627634696320:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1787784518.544279:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544295:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544306:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544339:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544346:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544352:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544739:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544749:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544757:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784518.544803:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544817:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544823:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544831:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544837:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.544841:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544854:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544866:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784518.544869:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.544874:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544880:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544896:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544902:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544909:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544914:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.544917:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544924:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544931:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdcf00) 00010000:00010000:0.0:1787784518.544933:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.544936:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544951:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544967:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544973:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544979:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544984:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.544986:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.544992:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.545000:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.545011:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.545015:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.545021:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.545109:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10445:x1874627634696320:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 905us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784518.545117:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:2.0:1787784518.547935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.548819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634696576 00000100:00100000:0.0:1787784518.548830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634696576 00000100:00100000:0.0:1787784518.549048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784518.549175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10445:x1874627634696576:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1787784518.549670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:10445:x1874627634696576:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 611us (1742us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787784518.549679:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1787784518.634591:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.634744:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634696832 00000100:00100000:0.0:1787784518.634754:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634696832 00000100:00100000:0.0:1787784518.634823:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1787784518.634834:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:10448:x1874627634696832:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784518.634859:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784518.634881:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa23 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.634962:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.634979:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.634990:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635005:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635012:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635037:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635535:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635546:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635554:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784518.635565:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787784518.635661:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635670:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635678:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635684:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.635687:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635694:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635706:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784518.635710:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.635721:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635727:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bae5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635740:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635746:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635752:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635757:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.635759:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635765:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635772:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdcf00) 00010000:00010000:0.0:1787784518.635775:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784518.635777:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635782:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635827:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa23 expref: 34 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635855:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa23 expref: 33 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.635862:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.635865:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784518.635867:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784518.635934:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10448:x1874627634696832:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1100us (1352us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787784518.635942:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:2.0:1787784518.650423:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784518.650581:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634696960 00000100:00100000:0.0:1787784518.650594:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634696960 00000100:00100000:0.0:1787784518.650671:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:0.0:1787784518.650682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10448:x1874627634696960:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784518.650753:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650770:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650780:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650810:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650818:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650844:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650851:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784518.650856:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650864:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650877:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:0.0:1787784518.650880:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784518.650885:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784518.650893:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784518.650990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10448:x1874627634696960:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 309us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784518.650999:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:1.0:1787784518.652293:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784518.652408:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634697088 00000100:00100000:2.0:1787784518.652416:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634697088 00000100:00100000:2.0:1787784518.652469:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784518.652478:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:2362:x1874627634697088:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784518.652492:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784518.652512:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bae6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa23 expref: 33 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.652530:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784518.652534:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784518.652582:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:2362:x1874627634697088:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784518.652589:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784518.656118:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784518.656317:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634697344 00000100:00100000:3.0:1787784518.656331:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634697344 00000100:00100000:3.0:1787784518.657205:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784518.657217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:10448:x1874627634697344:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784518.660181:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10448:x1874627634697344:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 2955us (4064us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787784518.660198:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784518.944782:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784518.944928:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634697600 00000100:00100000:2.0:1787784518.944937:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634697600 00000100:00100000:2.0:1787784518.944997:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1787784518.945016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10466:x1874627634697600:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1787784518.945041:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784518.945189:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bae82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa2a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.945314:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bae89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.945328:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bae89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.945339:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bae89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784518.945351:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787784518.945611:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bae82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa2a expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.945695:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bae89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa2a expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784518.945705:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:2.0:1787784518.945708:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787784518.945711:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500000, rc 0) 00000100:00100000:2.0:1787784518.945841:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10466:x1874627634697600:12345-192.168.202.59@tcp:101:cat.0 Request processed in 827us (1069us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787784518.945850:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:0.0:1787784518.971657:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643117056:0@lo:400:kworker.0 00000100:00100000:0.0:1787784518.971742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784518.972143:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117056 00000100:00100000:2.0:1787784518.972151:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117056 00000100:00100000:2.0:1787784518.972207:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787784518.972216:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643117056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.974588:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643117184:0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.974673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784518.974754:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117184 00000100:00100000:1.0:1787784518.974761:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117184 00000100:00100000:1.0:1787784518.974805:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787784518.974814:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643117184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.974867:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643117184:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784518.974875:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787784518.974917:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643117184:0@lo:400:kworker.0 00000100:00100000:2.0:1787784518.985039:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643117056:12345-0@lo:400:kworker.0 Request processed in 12814us (13286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784518.986188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787784518.987021:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643117056:0@lo:400:kworker.0 00000100:00100000:0.0:1787784518.987494:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643117568:0@lo:400:kworker.0 00000100:00100000:0.0:1787784518.987565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784518.987603:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784518.987610:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190444780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643117696:0@lo:400:kworker.0 00000100:00100000:0.0:1787784518.987725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784518.987761:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117568 00000100:00100000:0.0:1787784518.987768:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117568 00000100:00080000:0.0:1787784518.987797:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784518.987839:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787784518.987851:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643117568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784518.987902:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643117568:12345-0@lo:400:kworker.0 Request processed in 56us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784518.987909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787784518.987942:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643117568:0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.988299:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643117312:0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.988335:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784518.988532:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784518.988540:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431904470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643117440:0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.988564:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784518.988605:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117696 00000100:00100000:1.0:1787784518.988609:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117696 00000100:00100000:1.0:1787784518.989957:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117440 00000100:00100000:1.0:1787784518.989966:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117440 00000100:00100000:1.0:1787784518.990016:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787784518.990026:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643117696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.990202:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643117696:12345-0@lo:400:kworker.0 Request processed in 178us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784518.990220:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787784518.990235:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787784518.990240:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643117440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784518.990274:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643117440:12345-0@lo:400:kworker.0 Request processed in 34us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784518.990280:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787784518.990303:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784518.990334:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431904470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643117440:0@lo:400:kworker.0 00000100:00100000:2.0:1787784518.990927:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117312 00000100:00100000:2.0:1787784518.990933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117312 00000100:00100000:2.0:1787784518.990995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787784518.991015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643117312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784518.991075:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643117312:12345-0@lo:400:kworker.0 Request processed in 73us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784518.991081:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787784518.991941:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190444780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643117696:0@lo:400:kworker.0 00000100:00080000:1.0:1787784518.992209:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784518.992237:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643117312:0@lo:400:kworker.0 00000100:00100000:1.0:1787784519.017738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784519.017846:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634697728 00000100:00100000:0.0:1787784519.017857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634697728 00000100:00100000:0.0:1787784519.017940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:0.0:1787784519.017952:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10467:x1874627634697728:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784519.017978:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784519.018000:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa31 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018131:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018148:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018159:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784519.018426:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787784519.018431:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784519.018510:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018541:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bae97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa31 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018559:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa31 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.018568:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784519.018571:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784519.018575:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784519.018641:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10467:x1874627634697728:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 690us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784519.018648:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00080000:1.0:1787784519.018784:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784519.031786:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784519.031910:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698112 00000100:00100000:0.0:1787784519.031921:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698112 00000100:00100000:0.0:1787784519.031980:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:0.0:1787784519.031991:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10467:x1874627634698112:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1787784519.032397:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10467:x1874627634698112:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 407us (619us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787784519.032405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784519.039446:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784519.039592:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698240 00000100:00100000:1.0:1787784519.039603:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698240 00000100:00100000:1.0:1787784519.039679:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784519.039690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10467:x1874627634698240:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:1.0:1787784519.039707:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787784519.039730:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bae2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa15 expref: 37 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.039753:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bae89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa2a expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.039765:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bad32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a9d6 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.039785:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943197847600) 00010000:00010000:1.0:1787784519.039795:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784519.039855:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10467:x1874627634698240:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784519.039863:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784519.049985:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784519.050102:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698368 00000100:00100000:2.0:1787784519.050112:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698368 00000100:00100000:2.0:1787784519.050175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1787784519.050185:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10467:x1874627634698368:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:2.0:1787784519.050316:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.050331:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.050342:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784519.053968:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784519.054198:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787784519.054267:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787784519.059484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10467:x1874627634698368:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 9286us (9495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784519.059503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1787784519.127047:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784519.129984:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698496 00000100:00100000:0.0:1787784519.129998:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698496 00000100:00100000:2.0:1787784519.137851:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:2.0:1787784519.137866:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10469:x1874627634698496:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784519.137890:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784519.137912:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20baeac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa38 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.137983:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.137998:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.138257:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.138277:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.138285:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.138291:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139192:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139203:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139212:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784519.139261:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787784519.139266:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784519.139287:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139299:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139308:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139315:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139322:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139327:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784519.139332:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139338:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.139350:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784519.139353:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784519.139357:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140178:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20baeb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140217:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140224:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140231:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140236:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784519.140240:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140246:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140257:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183923500) 00010000:00010000:2.0:1787784519.140260:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784519.140263:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140269:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20baeba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140315:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20baeac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 36 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140330:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 35 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784519.140348:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784519.140351:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784519.140353:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500000, rc 0) 00000100:00100000:2.0:1787784519.141296:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10469:x1874627634698496:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 3428us (14253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784519.141307:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00010000:00010000:1.0:1787784519.285976:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784519.477062:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784519.477097:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643117824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784519.477190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784519.477354:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643117824 00000100:00100000:0.0:1787784519.477381:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643117824 00000100:00100000:0.0:1787784519.477441:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784519.477452:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874627643117824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784519.477491:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784519.477548:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874627643117824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784519.477556:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784519.477613:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643117824:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787784519.797790:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784519.797802:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784519.797987:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787784519.797995:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784519.798162:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319044f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643117952:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784519.798326:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784519.808197:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319044f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643117952:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784519.819837:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784519.824017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698624 00000100:00100000:3.0:1787784519.824033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698624 00000100:00100000:3.0:1787784519.824138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:3.0:1787784519.824149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698624:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787784519.824272:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698624:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 Request processed in 124us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784519.824281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1787784519.844226:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784519.844326:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698752 00000100:00100000:2.0:1787784519.844337:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698752 00000100:00100000:2.0:1787784519.844415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:2.0:1787784519.844425:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698752:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784519.844472:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784519.844583:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698752:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 158us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784519.844591:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:1.0:1787784519.853286:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784519.854015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634698880 00000100:00100000:0.0:1787784519.854028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634698880 00000100:00100000:0.0:1787784519.854111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:0.0:1787784519.854123:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698880:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787784519.854200:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854217:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854229:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854281:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854289:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854313:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854737:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854747:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854755:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784519.854796:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787784519.854800:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784519.854816:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854828:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854835:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854842:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854848:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784519.854852:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854860:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:0.0:1787784519.854882:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784519.854887:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854894:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20baec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854908:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854914:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854921:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854926:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784519.854928:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854934:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854942:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff943183fdcf00) 00010000:00010000:0.0:1787784519.854944:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784519.854947:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854952:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baecf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854979:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854986:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854991:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.854996:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784519.854998:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.855004:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.855012:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:0.0:1787784519.855014:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784519.855017:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.855022:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784519.857278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634698880:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 3147us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784519.857293:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1787784519.870552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784519.874306:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634699136 00000100:00100000:3.0:1787784519.874323:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634699136 00000100:00100000:3.0:1787784519.874416:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:3.0:1787784519.874428:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10480:x1874627634699136:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784519.874452:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784519.874476:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baedd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa3f expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874588:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874605:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874616:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784519.874628:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787784519.874732:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874739:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874755:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874762:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784519.874766:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874775:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874787:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:3.0:1787784519.874790:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784519.874795:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874801:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874847:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baedd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa3f expref: 37 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874856:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:3.0:1787784519.874859:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784519.874862:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baedd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa3f expref: 37 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.874872:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611c00, rc 0) 00000100:00100000:3.0:1787784519.874940:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699136:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 515us (4402us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787784519.874956:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:1.0:1787784519.884640:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784519.884720:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634699264 00000100:00100000:3.0:1787784519.884730:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634699264 00000100:00100000:3.0:1787784519.884791:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:3.0:1787784519.884800:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699264:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787784519.884847:0:8618:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787784519.884973:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699264:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 173us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784519.884981:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:1.0:1787784519.906816:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784519.906905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634699520 00000100:00100000:3.0:1787784519.906916:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634699520 00000100:00100000:3.0:1787784519.906981:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:3.0:1787784519.906991:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699520:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784519.907013:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784519.907016:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787784519.907119:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bae9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa31 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.907145:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784519.907151:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784519.907167:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baef2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa46 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784519.908599:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787784519.908887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.908912:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.908926:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.908997:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baef2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa46 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.909013:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa46 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.909022:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746ed00) 00010000:00010000:3.0:1787784519.909025:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784519.909028:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610000, rc 0) 00000100:00100000:3.0:1787784519.909119:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10480:x1874627634699520:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2129us (2313us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787784519.909128:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:1.0:1787784519.928859:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784519.930763:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634699776 00000100:00100000:0.0:1787784519.930777:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634699776 00000100:00100000:0.0:1787784519.930898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1787784519.930920:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10480:x1874627634699776:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784519.930988:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784519.931016:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20baef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa46 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.931033:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746ed00) 00010000:00010000:0.0:1787784519.931268:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784519.931300:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.931315:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.931326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932003:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932017:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932025:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932718:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932729:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932747:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932754:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784519.932759:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932766:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932778:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784519.932782:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784519.932787:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932794:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932806:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932811:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932818:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.932822:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784519.935273:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.935297:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.935312:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9dd80f25 (ffff943183fdcf00) 00010000:00010000:0.0:1787784519.935315:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784519.935319:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784519.935325:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20baf0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9dd80f25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784519.935487:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699776:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 4562us (6631us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787784519.935497:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:3.0:1787784519.941965:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784519.942003:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634699904 00000100:00100000:3.0:1787784519.942013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634699904 00000100:00100000:3.0:1787784519.942174:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:3.0:1787784519.942185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:10480:x1874627634699904:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784519.942207:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784519.942229:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baf15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa4d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942286:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942302:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942314:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942500:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baf15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942519:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784519.942529:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:3.0:1787784519.942532:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784519.942535:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611200, rc 0) 00000100:00100000:3.0:1787784519.942593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10480:x1874627634699904:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 410us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784519.942601:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:0.0:1787784519.963696:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784519.963943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634700160 00000100:00100000:1.0:1787784519.963957:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634700160 00000100:00100000:1.0:1787784519.964029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:1.0:1787784519.964041:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10480:x1874627634700160:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784519.964325:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.964357:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.964408:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784519.964999:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787784519.965012:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334791646094ns, next at 335791643642ns, rc = 0 00000004:00010000:1.0:1787784519.965188:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9613a5 reply state 000000009f1c4277 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784519.965199:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784519.965426:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:10480:x1874627634700160:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1320us (1675us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787784519.965437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 75 00010000:00010000:1.0:1787784519.975731:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975750:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975759:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975765:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784519.975771:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975780:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975813:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:1.0:1787784519.975816:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784519.975822:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.975840:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784519.981275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784519.990743:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634700288 00000100:00100000:1.0:1787784519.990755:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634700288 00000100:00100000:1.0:1787784519.990915:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:1.0:1787784519.990928:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:10480:x1874627634700288:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784519.990954:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784519.990977:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa54 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.991045:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.991061:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784519.991089:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:1.0:1787784519.991093:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784519.991097:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784519.991168:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:10480:x1874627634700288:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 243us (9904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784519.998740:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:1.0:1787784520.002952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.003451:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634700416 00000100:00100000:3.0:1787784520.003463:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634700416 00000100:00100000:3.0:1787784520.003510:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784520.003518:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874627634700416:12345-192.168.202.59@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787784520.003564:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:3.0:1787784520.003598:0:6677:0:(genops.c:1385:class_connect()) connect: client f9a4fd2c-0c67-4cd1-a267-69f5c190cff9, cookie 0xffb8d925c20baf31 00002000:00100000:3.0:1787784520.003833:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9a4fd2c-0c67-4cd1-a267-69f5c190cff9/ffff9431bee31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787784520.003860:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1787784520.004108:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787784520.004147:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9431bee32000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784520.004269:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2361:x1874627634700416:12345-192.168.202.59@tcp:8:lhsmtool_posix.0 Request processed in 750us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.004279:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:0.0:1787784520.019682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784520.019764:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634700544 00000100:00100000:1.0:1787784520.019774:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634700544 00000100:00100000:1.0:1787784520.019851:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784520.019862:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:0:x1874627634700544:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787784520.021154:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787784520.127245:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787784520.127268:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000100:00100000:1.0:1787784520.127495:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:0:x1874627634700544:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 107628us (107820us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787784520.127508:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784520.132170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.132928:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634700800 00000100:00100000:3.0:1787784520.132940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634700800 00000100:00100000:3.0:1787784520.132998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1787784520.133008:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:10480:x1874627634700800:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784520.133290:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:10480:x1874627634700800:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 283us (1131us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787784520.133936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1787784520.138109:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.138202:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701056 00000100:00100000:3.0:1787784520.138213:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701056 00000100:00100000:3.0:1787784520.138275:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1787784520.138288:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:10480:x1874627634701056:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784520.138952:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:10480:x1874627634701056:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 664us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.138963:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:1.0:1787784520.145468:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.145754:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701184 00000100:00100000:3.0:1787784520.145767:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701184 00000100:00100000:3.0:1787784520.145887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:3.0:1787784520.145898:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:10480:x1874627634701184:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784520.145922:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784520.145943:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20baf38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa5b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146057:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146085:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146096:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784520.146141:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784520.146172:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146199:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20baf38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa5b expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146218:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa5b expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.146227:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:3.0:1787784520.146229:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787784520.146233:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610c00, rc 0) 00000100:00100000:3.0:1787784520.146360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:10480:x1874627634701184:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 463us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.146423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:1.0:1787784520.150943:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784520.151006:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701312 00000100:00100000:2.0:1787784520.151017:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701312 00000100:00100000:2.0:1787784520.151089:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1787784520.151102:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634701312:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784520.151123:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784520.151147:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa62 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784520.151190:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6d48, blocks: 0x1 00010000:00010000:2.0:1787784520.151210:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1787784520.151215:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784520.151225:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 6 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.151247:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 6 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.151259:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500200, rc 0) 00000100:00100000:2.0:1787784520.151318:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634701312:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 220us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.151326:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:1.0:1787784520.158419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784520.158748:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701568 00000100:00100000:2.0:1787784520.158758:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701568 00000100:00100000:2.0:1787784520.158822:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:2.0:1787784520.158841:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431920692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:10480:x1874627634701568:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784520.158958:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431920692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:10480:x1874627634701568:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 119us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.158966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:2.0:1787784520.176874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.177105:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701696 00000100:00100000:3.0:1787784520.177118:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701696 00000100:00100000:3.0:1787784520.177185:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:3.0:1787784520.177206:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:10480:x1874627634701696:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784520.177226:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784520.177245:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa69 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.177286:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.177297:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787784520.177301:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784520.177307:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.177357:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.177413:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 7 pid: 8198 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.177429:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190444b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643118080:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784520.177532:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186804180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784520.183483:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784520.183525:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701824 00000100:00100000:0.0:1787784520.183534:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701824 00010000:00010000:0.0:1787784520.183581:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 8 pid: 8198 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.183636:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:0.0:1787784520.183663:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634701824:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784520.183680:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784520.183721:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 8 pid: 8198 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.183737:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 8 pid: 8198 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.183769:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784520.183775:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784520.183783:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.183794:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.183834:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.183850:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643118208:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784520.183938:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9aa80 going to sleep for 11 seconds 00010000:00010000:3.0:1787784520.184526:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20baf46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa62 expref: 8 pid: 8198 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.184544:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190444b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643118080:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784520.184584:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.184596:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610200, rc 0) 00000100:00100000:3.0:1787784520.184655:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10480:x1874627634701696:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 7451us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.184663:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:0.0:1787784520.197644:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784520.197693:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634701952 00000100:00100000:0.0:1787784520.197703:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634701952 00002000:00100000:0.0:1787784520.197754:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9431bed95680 x1874627634701952/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:401/0 lens 504/0 e 0 to 0 dl 1787784531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784520.197779:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431bed95680 with x1874627634701952 ext(0->8) 00002000:00010000:0.0:1787784520.197784:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431bed95680 00000100:00100000:0.0:1787784520.197811:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1787784520.197822:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634701952:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787784520.198533:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634701952:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 710us (906us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787784520.198542:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:0.0:1787784520.198550:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9431bed95680 x1874627634701952/t4294967302(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:401/0 lens 504/448 e 0 to 0 dl 1787784531 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784520.198559:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431bed95680 with x1874627634701952 ext(0->8) 00002000:00010000:0.0:1787784520.198564:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431bed95680 00000100:00100000:0.0:1787784520.198625:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed86d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643118208:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784520.198652:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784520.198673:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634701824:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 15013us (15202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784520.198682:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1787784520.206027:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.207612:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702080 00000100:00100000:3.0:1787784520.209458:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702080 00000100:00100000:3.0:1787784520.209552:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:3.0:1787784520.209562:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:10480:x1874627634702080:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787784520.311164:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784520.319126:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:10480:x1874627634702080:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 109553us (113096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784520.319141:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000001:00080000:1.0:1787784520.319186:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1787784520.319213:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787784520.319218:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787784520.319249:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787784520.319265:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1787784520.319416:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787784520.319426:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787784520.319434:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784520.319451:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643118336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787784520.319522:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784520.319673:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643118336 00000100:00100000:2.0:1787784520.319680:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643118336 00000100:00100000:2.0:1787784520.319741:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787784520.319755:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192068780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643118336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787784520.319910:0:8198:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787784520.319913:0:8198:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787784520 00002000:00010000:2.0:1787784520.319916:0:8198:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787784520.319918:0:8198:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787784520 -> 1787784520 00002000:00010000:2.0:1787784520.319921:0:8198:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787784520.319959:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192068780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643118336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (437us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787784520.319966:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787784520.320010:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94319206b480/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787784520.320016:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643118336:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1787784520.325954:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784520.333455:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784520.333553:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702208 00000100:00100000:2.0:1787784520.333564:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702208 00000100:00100000:2.0:1787784520.333639:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784520.333651:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2365:x1874627634702208:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000040:00080000:0.0:1787784520.338788:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784520.338799:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784520.338835:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787784520.338841:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787784520.389401:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787784520.389427:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787784520.390578:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634702208:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 56922us (57124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.390591:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784520.403558:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784520.403696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702464 00000100:00100000:0.0:1787784520.403714:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702464 00000100:00100000:0.0:1787784520.403775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1787784520.403785:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10480:x1874627634702464:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784520.403844:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784520.403873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20baf3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa5b expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.403891:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:0.0:1787784520.403896:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784520.403928:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.403942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.403953:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784520.404241:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb3309e reply state 000000005a6f8d77 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.404252:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784520.404356:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10480:x1874627634702464:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 572us (808us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787784520.404392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1787784520.409247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.411149:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702592 00000100:00100000:3.0:1787784520.411165:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702592 00000100:00100000:3.0:1787784520.411230:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:3.0:1787784520.411241:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431870f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634702592:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787784520.411508:0:8198:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787784520.411512:0:8198:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787784520 -> 1787784518 00002000:00010000:3.0:1787784520.411515:0:8198:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787784516 00002000:00010000:3.0:1787784520.411517:0:8198:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787784520 -> 1787784518 00002000:00010000:3.0:1787784520.411519:0:8198:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787784520.419958:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.419975:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.419982:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.419989:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784520.420011:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.420020:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.420038:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:2.0:1787784520.420041:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784520.420046:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.420053:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20baf54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.420845:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431870f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634702592:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 9598us (11599us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787784520.420858:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:1.0:1787784520.427923:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784520.427989:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702848 00000100:00100000:0.0:1787784520.427999:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702848 00000100:00100000:0.0:1787784520.428054:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:0.0:1787784520.428063:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10480:x1874627634702848:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787784520.428148:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.428167:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.428177:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.428206:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.428219:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 13 pid: 5831 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.428234:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643118464:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784520.428312:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784520.431798:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.432227:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634702976 00000100:00100000:3.0:1787784520.432249:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634702976 00010000:00010000:3.0:1787784520.432288:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 14 pid: 5831 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.432450:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1787784520.432460:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192069680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2362:x1874627634702976:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784520.432474:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784520.432482:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 14 pid: 5831 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.432496:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 14 pid: 5831 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.432519:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:3.0:1787784520.432525:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.432534:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.432543:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.432564:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784520.432875:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20baf1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa4d expref: 14 pid: 5831 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.432891:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643118464:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784520.432914:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432923:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432928:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432967:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432974:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432981:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432986:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784520.432990:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.432998:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.433007:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:0.0:1787784520.433011:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787784520.433014:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.433020:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.433068:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192069a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10480:x1874627634702848:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 5006us (5467us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787784520.433087:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:3.0:1787784520.450812:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192069680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2362:x1874627634702976:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 18337us (19008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.450829:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1787784520.452515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784520.452552:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784520.452582:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784520.452611:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784520.452710:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703232 00000100:00100000:1.0:1787784520.452722:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703232 00000100:00100000:1.0:1787784520.452777:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 295 00000100:00100000:1.0:1787784520.452786:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634703232:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784520.452857:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634703232:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784520.452865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 295 00000100:00100000:1.0:1787784520.452899:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703488 00000100:00100000:1.0:1787784520.452903:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703488 00000100:00100000:1.0:1787784520.452949:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00100000:1.0:1787784520.452957:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634703488:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784520.452990:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192068f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634703488:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784520.452997:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00080000:1.0:1787784520.453016:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784520.453028:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703104 00000100:00100000:1.0:1787784520.453031:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703104 00000100:00100000:1.0:1787784520.453053:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703360 00000100:00100000:1.0:1787784520.453064:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703360 00000100:00100000:1.0:1787784520.453107:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:1.0:1787784520.453114:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634703360:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784520.453143:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634703360:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784520.453150:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:1.0:1787784520.453162:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1787784520.453169:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192068b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634703104:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787784520.453201:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.453223:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.453233:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784520.453238:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784520.453243:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.453281:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.453296:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 7 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784520.453310:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192068000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643118592:192.168.202.59@tcp:104: 00000100:00080000:3.0:1787784520.455467:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784520.456805:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787784520.462424:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192068000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643118592:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784520.462457:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784520.463467:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784520.463586:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703616 00000100:00100000:2.0:1787784520.463596:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703616 00010000:00010000:2.0:1787784520.463739:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784520.463780:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:2.0:1787784520.463789:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634703616:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784520.463803:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784520.463825:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.463850:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.463874:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6911ff/0xffb8d925c20baf4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aa69 expref: 8 pid: 6679 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.463889:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784520.463894:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784520.463900:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.463910:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784520.463935:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784520.463984:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634703616:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 196us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.463992:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00010000:00010000:3.0:1787784520.467545:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467570:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467612:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467631:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467642:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467650:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784520.467655:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467663:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467683:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.467691:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3de231b/0xffb8d925c20baf62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.467794:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192068b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634703104:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 14619us (15283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.467806:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:2.0:1787784520.473086:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784520.475772:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634703872 00000100:00100000:0.0:1787784520.475789:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634703872 00000100:00100000:0.0:1787784520.475870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:0.0:1787784520.475887:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:10480:x1874627634703872:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787784520.475968:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.475983:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.475995:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.476232:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.476242:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.476251:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.476286:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.476301:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 13 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.476314:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643118720:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784520.476449:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784520.484020:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.485343:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634704000 00000100:00100000:3.0:1787784520.485357:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634704000 00010000:00010000:3.0:1787784520.485427:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 14 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.485466:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1787784520.485476:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2362:x1874627634704000:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784520.485495:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784520.485503:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 14 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.485521:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 14 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.485545:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:3.0:1787784520.485551:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.485561:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.485570:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.485605:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784520.485684:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2362:x1874627634704000:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 209us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.485692:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00010000:00010000:0.0:1787784520.490556:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa54 expref: 13 pid: 5832 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.490599:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643118720:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784520.490698:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.490710:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.490716:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784520.490922:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787784520.491099:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787784520.491147:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787784520.491250:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874627643118848:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787784520.491314:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.492751:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784520.492870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643118848 00000100:00100000:2.0:1787784520.492881:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643118848 00000100:00100000:2.0:1787784520.492951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784520.492964:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874627643118848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787784520.493125:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874627643118848:12345-0@lo:1000:mdt00_001.0 Request processed in 164us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784520.493141:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784520.495588:0:5832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787784520.495601:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94319206b480, transno 4294967303 00000100:00100000:0.0:1787784520.495724:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874627643118848:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787784520.496266:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787784520.496395:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874627643118976:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787784520.496459:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784520.496492:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887ef900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784520.496816:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643118976 00000100:00100000:2.0:1787784520.496823:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643118976 00000100:00100000:2.0:1787784520.496879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784520.496889:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1874627643118976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787784520.497103:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1874627643118976:12345-0@lo:1000:mdt00_001.0 Request processed in 215us (643us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787784520.497111:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784520.497529:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed97840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1874627643118976:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787784520.497573:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497598:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497606:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497612:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784520.497617:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497694:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497710:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746e500) 00010000:00010000:0.0:1787784520.497713:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784520.497718:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497724:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20baf70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497761:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497768:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497773:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497778:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784520.497787:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497793:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497802:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:0.0:1787784520.497804:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784520.497807:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20baea5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497854:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497871:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 16 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497881:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497915:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 16 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.497932:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 16 pid: 8617 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.497945:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed96940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643119104:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784520.498021:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784520.510549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.510598:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634704128 00000100:00100000:3.0:1787784520.510606:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634704128 00010000:00010000:3.0:1787784520.510659:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 17 pid: 8617 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784520.510704:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1787784520.510713:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:2362:x1874627634704128:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784520.510730:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784520.510736:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 17 pid: 8617 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.510748:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 17 pid: 8617 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.510772:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:3.0:1787784520.510778:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.510790:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.510798:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.510835:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784520.510894:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:2362:x1874627634704128:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 182us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784520.510902:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00010000:00010000:0.0:1787784520.511767:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20baec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa38 expref: 16 pid: 8617 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.511786:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed96940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643119104:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784520.511812:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511821:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511827:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511840:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511847:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511854:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511860:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784520.511864:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511871:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511883:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:0.0:1787784520.511886:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784520.511900:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20baf77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511917:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511923:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511929:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511935:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784520.511937:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511943:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511951:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943183923d00) 00010000:00010000:0.0:1787784520.511953:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784520.511956:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784520.511962:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20baf69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784520.512245:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10480:x1874627634703872:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 36359us (39181us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787784520.512256:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000020:00080000:0.0:1787784520.512266:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787784520.518197:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784520.518269:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634704384 00000100:00100000:3.0:1787784520.518278:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634704384 00000100:00100000:3.0:1787784520.518339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1787784520.518350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10480:x1874627634704384:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787784520.519140:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787784520.519246:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787784520.519295:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519326:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519335:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519341:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519349:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784520.519390:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784520.519497:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:10480:x1874627634704384:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1146us (1304us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787784520.519507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000020:00080000:3.0:1787784520.519512:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787784520.519863:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784520.519872:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.519880:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784520.519885:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.519895:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.519908:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94319746ef00) 00010000:00010000:1.0:1787784520.519912:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787784520.519917:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.519923:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20baf7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784520.519945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784520.519947:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784520.519949:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784520.520748:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784520.520758:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784520.520793:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787784520.520802:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787784521.333685:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787784521.635819:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1787784521.635850:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1787784522.363435:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784522.548504:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784522.548526:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431920683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643119232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784522.548606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784522.548677:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643119232 00000100:00100000:1.0:1787784522.548688:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643119232 00000100:00100000:1.0:1787784522.548747:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787784522.548756:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643119232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784522.548803:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784522.548841:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9ea0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643119232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.548846:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787784522.549088:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784522.549128:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431920683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643119232:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787784522.594166:0:12045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784522.594177:0:12045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784522.594215:0:12045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787784522.594222:0:12045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787784522.798872:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784522.798941:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634704640 00000100:00100000:3.0:1787784522.798952:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634704640 00000100:00100000:3.0:1787784522.799101:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:3.0:1787784522.799114:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:10500:x1874627634704640:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784522.799140:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784522.799165:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baf85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa70 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.799507:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20baf8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.799525:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20baf8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.799538:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20baf8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784522.799552:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:1.0:1787784522.799821:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787784522.800015:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baf85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa70 expref: 20 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.800032:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20baf8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa70 expref: 19 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.800270:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784522.800274:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787784522.800278:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610e00, rc 0) 00000100:00100000:3.0:1787784522.800434:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10500:x1874627634704640:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1322us (1575us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787784522.800442:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:0.0:1787784522.808201:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784522.808357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634704768 00000100:00100000:1.0:1787784522.808429:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634704768 00000100:00100000:1.0:1787784522.809766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:1.0:1787784522.809783:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10500:x1874627634704768:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:1.0:1787784522.809868:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.809886:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.809898:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.809916:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.809936:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.809944:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810239:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810249:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810257:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784522.810302:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810315:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810322:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810330:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810336:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.810340:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810349:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810385:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784522.810388:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.810393:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810400:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20baf9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810411:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810418:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810424:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810430:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.810433:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810439:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810447:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486300) 00010000:00010000:1.0:1787784522.810449:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.810452:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810458:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810484:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810491:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810497:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810502:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.810506:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810512:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810518:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486600) 00010000:00010000:1.0:1787784522.810521:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.810524:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.810531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.810817:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10500:x1874627634704768:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1036us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784522.810828:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:3.0:1787784522.885418:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784522.898756:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634705024 00000100:00100000:1.0:1787784522.898773:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634705024 00000100:00100000:1.0:1787784522.898854:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1787784522.898873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10503:x1874627634705024:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784522.898896:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784522.898922:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa77 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899001:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899017:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899031:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899062:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899071:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899078:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899451:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784522.899490:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787784522.899698:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899708:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899715:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899722:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.899727:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899735:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899748:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784522.899751:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.899756:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899763:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899778:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899785:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899801:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899807:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.899810:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899817:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899824:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486600) 00010000:00010000:1.0:1787784522.899827:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.899830:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899837:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899897:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.899906:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:1.0:1787784522.899908:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784522.899911:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784522.900011:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10503:x1874627634705024:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1140us (14602us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787784522.900030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:0.0:1787784522.912194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784522.912263:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634705152 00000100:00100000:3.0:1787784522.912273:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634705152 00000100:00100000:3.0:1787784522.912329:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:3.0:1787784522.912338:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10503:x1874627634705152:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:3.0:1787784522.912438:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912455:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912468:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912498:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912505:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912513:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912536:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784522.912540:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912549:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912562:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:3.0:1787784522.912565:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784522.912570:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.912577:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20bafd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.912652:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10503:x1874627634705152:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 314us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.912661:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1787784522.919636:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784522.919832:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634705408 00000100:00100000:3.0:1787784522.919842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634705408 00000100:00100000:2.0:1787784522.920002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784522.920014:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac780850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10503:x1874627634705408:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784522.920316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac780850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:10503:x1874627634705408:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 303us (692us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787784522.920325:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1787784522.958570:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784522.958682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634705664 00000100:00100000:1.0:1787784522.958692:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634705664 00000100:00100000:1.0:1787784522.958753:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:1.0:1787784522.958762:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:10022:x1874627634705664:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784522.958786:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784522.958806:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa7e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.958913:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.958927:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.958936:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.958971:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.958985:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 23 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.958999:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431920683c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643119360:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784522.959111:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431890916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784522.970461:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784522.970567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634705792 00000100:00100000:3.0:1787784522.970576:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634705792 00010000:00010000:3.0:1787784522.970635:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 24 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784522.970676:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1787784522.970685:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:2362:x1874627634705792:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784522.970701:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784522.970714:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 24 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.970728:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 24 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.970758:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:3.0:1787784522.970763:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.970772:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.970779:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.970799:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784522.971022:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:2362:x1874627634705792:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 337us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.971031:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00010000:00010000:0.0:1787784522.971123:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bafc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa77 expref: 23 pid: 5832 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784522.971144:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431920683c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643119360:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784522.971165:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.971175:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.971181:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784522.971200:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787784522.971359:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bafd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.971501:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784522.971509:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:0.0:1787784522.971512:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787784522.971515:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784522.971617:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10022:x1874627634705664:12345-192.168.202.59@tcp:101:bash.0 Request processed in 12854us (13055us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787784522.971626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:2.0:1787784522.982883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784522.988093:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706048 00000100:00100000:1.0:1787784522.988110:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706048 00000100:00100000:1.0:1787784522.988191:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:1.0:1787784522.988202:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10022:x1874627634706048:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:1.0:1787784522.988514:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.988532:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.988544:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784522.988598:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787784522.988623:0:8617:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059c8547a reply state 0000000073e09cc9 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784522.988631:0:8617:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787784522.988679:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787784522.988803:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10022:x1874627634706048:12345-192.168.202.59@tcp:36:bash.0 Request processed in 602us (5931us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787784522.988812:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 89 00000020:00080000:1.0:1787784522.988818:0:8617:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787784522.993641:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993659:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993682:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993689:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784522.993693:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993704:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993719:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:1.0:1787784522.993722:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784522.993727:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784522.993733:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bafee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784522.999445:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784522.999592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706176 00000100:00100000:3.0:1787784522.999603:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706176 00000100:00100000:3.0:1787784522.999671:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:3.0:1787784522.999684:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10022:x1874627634706176:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784522.999712:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784522.999735:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.999807:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa85 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.999837:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa85 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784522.999858:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:3.0:1787784522.999861:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784522.999865:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611c00, rc 0) 00000100:00100000:3.0:1787784522.999935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10022:x1874627634706176:12345-192.168.202.59@tcp:101:bash.0 Request processed in 253us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784522.999942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:2.0:1787784523.004912:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.005021:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706304 00000100:00100000:0.0:1787784523.005032:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706304 00000100:00100000:0.0:1787784523.005174:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1787784523.005188:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:10022:x1874627634706304:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784523.005213:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784523.005239:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa8c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784523.005273:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6d46, atime: 0x6a8f6d44, ctime: 0x6a8f6d46, blocks: 0xb 00010000:00010000:0.0:1787784523.005296:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1787784523.005302:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784523.005312:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.005335:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.005349:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89e00, rc 0) 00000100:00100000:0.0:1787784523.005448:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10022:x1874627634706304:12345-192.168.202.59@tcp:101:bash.0 Request processed in 264us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784523.005457:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00080000:1.0:1787784523.005525:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784523.007785:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.007878:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706432 00000100:00100000:0.0:1787784523.007888:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706432 00002000:00010000:0.0:1787784523.007934:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787784523.007939:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9f00780 with x1874627634706432 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784523.007950:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9f00780. 00000100:00100000:0.0:1787784523.008024:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:0.0:1787784523.008058:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634706432:12345-192.168.202.59@tcp:10:bash.0 00002000:00010000:0.0:1787784523.008435:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787784523.008439:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787784518 -> 1787784523 00002000:00010000:0.0:1787784523.008443:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787784516 -> 1787784516 00002000:00010000:0.0:1787784523.008446:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787784518 -> 1787784523 00002000:00010000:0.0:1787784523.008448:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787784523.008519:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634706432:12345-192.168.202.59@tcp:10:bash.0 Request processed in 473us (744us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787784523.008528:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00002000:00010000:0.0:1787784523.008531:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787784523.008534:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9f00780 with x1874627634706432 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784523.008539:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9f00780. 00000100:00100000:2.0:1787784523.127519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.127786:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706560 00000100:00100000:1.0:1787784523.127798:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706560 00000100:00100000:1.0:1787784523.127867:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:1.0:1787784523.127877:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10517:x1874627634706560:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:1.0:1787784523.127955:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.127974:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.127999:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128033:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128040:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128057:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128350:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128360:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128506:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784523.128550:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128560:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128566:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128572:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128576:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.128580:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128593:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128616:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784523.128620:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.128625:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128630:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128644:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128649:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128655:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128660:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.128662:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128668:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486600) 00010000:00010000:1.0:1787784523.128677:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.128680:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128695:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb00a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128710:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128716:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128722:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128727:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.128730:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128737:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128744:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:1.0:1787784523.128746:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.128749:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.128755:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.128845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10517:x1874627634706560:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 967us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.128856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:2.0:1787784523.204148:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.204259:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706816 00000100:00100000:1.0:1787784523.204270:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706816 00000100:00100000:1.0:1787784523.204347:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:1.0:1787784523.204358:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:10520:x1874627634706816:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784523.205101:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784523.205126:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa93 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205202:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205216:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205229:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205242:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205250:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.205256:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.207172:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.207192:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.207218:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784523.207232:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787784523.210083:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210102:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210109:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210115:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.210120:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210127:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210144:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784523.210147:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.210151:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210157:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb01f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210174:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210180:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210201:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210206:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.210209:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210216:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210223:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486600) 00010000:00010000:1.0:1787784523.210226:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.210228:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210234:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210295:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa93 expref: 30 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210322:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb02d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa93 expref: 29 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.210329:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:1.0:1787784523.210331:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787784523.210334:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512000, rc 0) 00000100:00100000:1.0:1787784523.212699:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10520:x1874627634706816:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 8329us (8548us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787784523.212733:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:2.0:1787784523.220926:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.221121:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634706944 00000100:00100000:3.0:1787784523.221131:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634706944 00000100:00100000:3.0:1787784523.221196:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:3.0:1787784523.221206:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10520:x1874627634706944:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:3.0:1787784523.221278:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.221296:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.221305:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.221349:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.222574:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 29 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.222826:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190444000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874627643119488:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784523.222938:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431811ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784523.233693:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.233830:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634707200 00000100:00100000:1.0:1787784523.233841:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634707200 00000100:00100000:1.0:1787784523.233909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1787784523.233920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:5606:x1874627634707200:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787784523.234299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:5606:x1874627634707200:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 380us (617us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787784523.234308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784523.234539:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190444000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874627643119488:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784523.234565:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.238003:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.238173:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634707328 00000100:00100000:3.0:1787784523.238183:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634707328 00010000:00010000:3.0:1787784523.238227:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 31 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.238269:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1787784523.238280:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:2362:x1874627634707328:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784523.238295:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784523.238303:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 31 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238316:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 31 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238339:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bafe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aa7e expref: 31 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238355:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:3.0:1787784523.238360:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238435:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238443:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.238483:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784523.238537:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:2362:x1874627634707328:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 259us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.238546:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00010000:00010000:2.0:1787784523.238798:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238814:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238848:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238855:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238861:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238868:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784523.238873:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238880:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238890:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:2.0:1787784523.238892:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784523.238896:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.238902:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.238942:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10520:x1874627634706944:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 17737us (18027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.238951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:0.0:1787784523.255295:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.255426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634707584 00000100:00100000:3.0:1787784523.255438:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634707584 00000100:00100000:3.0:1787784523.255504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784523.255514:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:10520:x1874627634707584:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784523.255787:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10520:x1874627634707584:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 274us (506us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787784523.255796:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00010000:00010000:3.0:1787784523.380614:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784523.416110:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.416296:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634707840 00000100:00100000:0.0:1787784523.416308:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634707840 00000100:00100000:0.0:1787784523.416464:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:0.0:1787784523.416475:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+30:10531:x1874627634707840:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:0.0:1787784523.416506:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784523.416527:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aa9a expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416609:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416625:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416662:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416681:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416688:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.416694:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417071:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417082:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417089:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784523.417101:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787784523.417204:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417213:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417221:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417227:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784523.417237:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417263:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417277:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784523.417281:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784523.417286:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417294:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417307:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417314:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417318:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417324:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784523.417326:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417331:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417338:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdce00) 00010000:00010000:0.0:1787784523.417340:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784523.417350:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417356:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417473:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa9a expref: 33 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417487:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa9a expref: 32 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.417493:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:0.0:1787784523.417495:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784523.417497:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89400, rc 0) 00000100:00100000:0.0:1787784523.417568:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:10531:x1874627634707840:12345-192.168.202.59@tcp:101:cat.0 Request processed in 1094us (1467us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787784523.417576:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:0.0:1787784523.422541:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.422608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708096 00000100:00100000:3.0:1787784523.422620:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708096 00000100:00100000:3.0:1787784523.422687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:3.0:1787784523.422698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:10531:x1874627634708096:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:3.0:1787784523.422974:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10531:x1874627634708096:12345-192.168.202.59@tcp:35:cat.0 Request processed in 277us (445us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787784523.422982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1787784523.439687:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.439751:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708352 00000100:00100000:1.0:1787784523.439761:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708352 00000100:00100000:1.0:1787784523.439899:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:1.0:1787784523.439910:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10532:x1874627634708352:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:1.0:1787784523.439973:0:8617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787784523.440001:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa9a expref: 33 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440026:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb02d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa93 expref: 32 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440041:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611c00/0xffb8d925c20baff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa85 expref: 31 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440063:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486300) 00010000:00010000:1.0:1787784523.440074:0:8617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784523.440095:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440122:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440133:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440149:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440157:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440164:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440581:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440592:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.440599:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784523.441981:0:8617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787784523.441995:0:8617:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338268629801ns, next at 339268625938ns, rc = 0 00010000:00010000:1.0:1787784523.442086:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442101:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442126:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442135:0:8617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442141:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442147:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442175:0:8617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784523.442202:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442208:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442214:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442220:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.442225:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442232:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442244:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486d00) 00010000:00010000:1.0:1787784523.442247:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787784523.442260:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442268:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb073 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442292:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442299:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442305:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442310:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.442313:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442319:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442327:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784523.442329:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.442332:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.442337:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784523.442349:0:8617:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9306334 reply state 000000007b237015 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.442412:0:8617:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784523.442509:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:10532:x1874627634708352:12345-192.168.202.59@tcp:36:rm.0 Request processed in 2597us (2829us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787784523.442519:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00010000:00010000:3.0:1787784523.443054:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784523.443064:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.443072:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784523.443076:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.443083:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.443095:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff943190486d00) 00010000:00010000:3.0:1787784523.443098:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787784523.443101:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.443108:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb07a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.443127:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784523.443129:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784523.443131:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784523.447695:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447713:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447721:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447729:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784523.447734:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447742:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447760:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486600) 00010000:00010000:2.0:1787784523.447763:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784523.447768:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.447775:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb06c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.489627:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.489726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708608 00000100:00100000:3.0:1787784523.489735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708608 00000100:00100000:3.0:1787784523.489784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:3.0:1787784523.489791:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:10538:x1874627634708608:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784523.489813:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784523.489831:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aaa1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.489948:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.489973:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.489982:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.489993:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.489997:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490001:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787784523.490752:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787784523.490927:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490939:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490949:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490982:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490989:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.490997:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491009:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784523.491013:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491022:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491035:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784523.491038:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784523.491042:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491200:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784523.491215:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091155b88 reply state 0000000099ed92dd transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.491223:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787784523.491253:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491267:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.491274:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:3.0:1787784523.491277:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784523.491279:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610400, rc 0) 00000100:00100000:3.0:1787784523.491533:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10538:x1874627634708608:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1739us (1916us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787784523.491547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00010000:00010000:1.0:1787784523.493118:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493134:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493143:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493150:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.493155:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493163:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493177:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94319746e300) 00010000:00010000:1.0:1787784523.493180:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784523.493184:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.493191:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb08f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.496172:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.496269:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708736 00000100:00100000:1.0:1787784523.496280:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708736 00000100:00100000:1.0:1787784523.496418:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1787784523.496429:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634708736:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784523.496449:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784523.496471:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aaa8 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787784523.496500:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784523.496520:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1787784523.496524:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784523.496535:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 6 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.496555:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 6 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.496569:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784523.496625:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634708736:12345-192.168.202.59@tcp:101:bash.0 Request processed in 198us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.496633:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00080000:3.0:1787784523.496707:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784523.501246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.501339:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708864 00000100:00100000:3.0:1787784523.501350:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708864 00000100:00100000:3.0:1787784523.501506:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1787784523.501515:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:10538:x1874627634708864:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784523.501535:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784523.501553:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aaaf expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.501585:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.501594:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784523.501599:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784523.501669:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.501704:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.501718:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.501733:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190446940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874627643119616:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784523.501850:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431811ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784523.505179:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.505294:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190446940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874627643119616:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784523.505339:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.505360:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610800, rc 0) 00000100:00100000:3.0:1787784523.505459:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:10538:x1874627634708864:12345-192.168.202.59@tcp:101:bash.0 Request processed in 3944us (4224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.505468:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:1.0:1787784523.507175:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634708992 00000100:00100000:1.0:1787784523.507188:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634708992 00010000:00010000:1.0:1787784523.507236:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.507280:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:1.0:1787784523.507290:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634708992:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784523.507331:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784523.507355:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.507387:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.507411:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa8 expref: 7 pid: 8198 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.507427:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784523.507432:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784523.507440:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.507452:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.507489:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.507504:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192069e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643119744:192.168.202.59@tcp:105: 00000100:00100000:1.0:1787784523.507590:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431890916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784523.511629:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192069e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643119744:192.168.202.59@tcp:105: 00010000:00010000:1.0:1787784523.511658:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784523.511733:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634708992:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 4443us (6564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784523.511745:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:2.0:1787784523.517358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.517488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634709248 00000100:00100000:3.0:1787784523.517497:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634709248 00000100:00100000:3.0:1787784523.517557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784523.517568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:10538:x1874627634709248:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:3.0:1787784523.517964:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10538:x1874627634709248:12345-192.168.202.59@tcp:35:bash.0 Request processed in 397us (617us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787784523.517972:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:2.0:1787784523.728870:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.729011:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634709376 00000100:00100000:0.0:1787784523.729022:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634709376 00000100:00100000:0.0:1787784523.729116:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1787784523.729127:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:10554:x1874627634709376:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784523.729151:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784523.729172:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb0b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aab6 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729256:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729270:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729281:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784523.729355:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787784523.729360:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784523.729423:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729449:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb0b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aab6 expref: 36 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729467:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aab6 expref: 35 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.729475:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784523.729477:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784523.729481:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89a00, rc 0) 00000100:00100000:0.0:1787784523.729550:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10554:x1874627634709376:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 425us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784523.729558:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1787784523.737273:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.737444:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634709632 00000100:00100000:1.0:1787784523.737462:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634709632 00000100:00100000:1.0:1787784523.737520:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:1.0:1787784523.737530:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:10554:x1874627634709632:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784523.737552:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784523.737574:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb0c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aabd expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.737696:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.737711:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.737723:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784523.737734:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787784523.737856:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb0c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aabd expref: 38 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.737875:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aabd expref: 37 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.737884:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:1.0:1787784523.737887:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784523.737901:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0600, rc 0) 00000100:00100000:1.0:1787784523.737968:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10554:x1874627634709632:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 439us (703us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787784523.737976:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:3.0:1787784523.741867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784523.742037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634709888 00000100:00100000:2.0:1787784523.742057:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634709888 00000100:00100000:2.0:1787784523.742122:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1787784523.742147:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:10554:x1874627634709888:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784523.742174:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784523.742199:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb0d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aac4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.742317:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.742333:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.742345:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784523.742358:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787784523.742535:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb0d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aac4 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.742554:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aac4 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.742563:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:2.0:1787784523.742566:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787784523.742569:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500600, rc 0) 00000100:00100000:2.0:1787784523.742643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:10554:x1874627634709888:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 499us (787us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787784523.742650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1787784523.748191:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.748282:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710016 00000100:00100000:3.0:1787784523.748293:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710016 00000100:00100000:3.0:1787784523.748413:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784523.748424:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:2364:x1874627634710016:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784523.748441:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784523.748476:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aabd expref: 39 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.748521:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:3.0:1787784523.748527:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784523.748603:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:2364:x1874627634710016:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 172us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.748611:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:3.0:1787784523.755333:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.755453:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710144 00000100:00100000:1.0:1787784523.755467:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710144 00000100:00100000:1.0:1787784523.755540:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:1.0:1787784523.755551:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634710144:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:1.0:1787784523.755652:0:8198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.755677:0:8198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.755687:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784523.755693:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784523.755698:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.755761:0:8198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.755778:0:8198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 6 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.755793:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643119872:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784523.755908:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.758955:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.759081:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710272 00000100:00100000:0.0:1787784523.759097:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710272 00002000:00100000:0.0:1787784523.759147:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9431b3fbc3c0 x1874627634710272/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:404/0 lens 504/0 e 0 to 0 dl 1787784534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784523.759159:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b3fbc3c0 with x1874627634710272 ext(0->8) 00010000:00010000:0.0:1787784523.759169:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 7 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.759185:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 7 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784523.759194:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9431b3fbc3c0 00000100:00100000:0.0:1787784523.759230:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:0.0:1787784523.759240:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634710272:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:0.0:1787784523.759835:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2365:x1874627634710272:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 592us (885us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787784523.759846:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00002000:00100000:0.0:1787784523.759855:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9431b3fbc3c0 x1874627634710272/t4294967302(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:404/0 lens 504/448 e 0 to 0 dl 1787784534 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784523.759865:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b3fbc3c0 with x1874627634710272 ext(0->8) 00010000:00010000:0.0:1787784523.759872:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.759887:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784523.759894:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9431b3fbc3c0 00000100:00100000:1.0:1787784523.763446:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643119872:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784523.763478:0:8198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784523.766346:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.766726:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710400 00000100:00100000:3.0:1787784523.766739:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710400 00010000:00010000:3.0:1787784523.766796:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.766840:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1787784523.766851:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634710400:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784523.766870:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787784523.766896:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787784523.766899:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787784523 00002000:00010000:3.0:1787784523.766902:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787784524 00002000:00010000:3.0:1787784523.766905:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787784523 00010000:00010000:3.0:1787784523.766912:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.766933:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.766962:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb0ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849aaaf expref: 9 pid: 6677 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.767001:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784523.767007:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784523.767014:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.767028:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.767089:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784523.767168:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634710400:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 319us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.767178:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00010000:00010000:2.0:1787784523.767343:0:8198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767355:0:8198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767439:0:8198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767451:0:8198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767461:0:8198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767470:0:8198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784523.767475:0:8198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767487:0:8198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767501:0:8198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.767509:0:8198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a64bd2/0xffb8d925c20bb0ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.767730:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634710144:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 12179us (12406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.767741:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784523.770803:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.770983:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710656 00000100:00100000:1.0:1787784523.770995:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710656 00000100:00100000:1.0:1787784523.771081:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784523.771093:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac780c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:10554:x1874627634710656:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:1.0:1787784523.771170:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aac4 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784523.771498:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787784523.771560:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787784523.772076:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787784523.772133:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.772149:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.772159:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.772198:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.772215:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 42 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.772253:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643120000:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784523.772344:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784523.782332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.782565:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710784 00000100:00100000:3.0:1787784523.782576:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710784 00010000:00010000:3.0:1787784523.782635:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 43 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784523.782682:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1787784523.782693:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:2363:x1874627634710784:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784523.782710:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784523.782717:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 43 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.782732:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 43 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.782771:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:3.0:1787784523.782778:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.782787:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.782796:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.782818:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784523.782878:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:2363:x1874627634710784:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 186us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784523.782885:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00010000:00010000:1.0:1787784523.783169:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaa1 expref: 42 pid: 5831 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.783188:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643120000:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784523.783211:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.783220:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.783226:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784523.783439:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787784523.783679:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787784523.783826:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643120128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787784523.783879:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.783910:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318b1460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784523.784161:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120128 00000100:00100000:2.0:1787784523.784170:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120128 00000100:00100000:2.0:1787784523.784245:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784523.784254:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643120128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784523.784348:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643120128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.784356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784523.784404:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787784523.784411:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787784523.784431:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9431918d43c0, transno 4294967301 00000100:00100000:1.0:1787784523.784456:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643120128:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1787784523.784727:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787784523.784904:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787784523.784967:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643120256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787784523.785005:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784523.785031:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189091300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784523.785083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120256 00000100:00100000:3.0:1787784523.785088:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120256 00000100:00100000:3.0:1787784523.785125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784523.785132:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643120256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787784523.785548:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874627643120256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 416us (541us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787784523.785558:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784523.785636:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192069680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643120256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787784523.785687:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787784523.785727:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785739:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785748:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785755:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784523.785761:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785770:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785790:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:1.0:1787784523.785793:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787784523.785798:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784523.785806:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb0f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784523.785972:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787784523.786067:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787784523.786080:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338612714597ns, next at 339612712132ns, rc = 0 00000001:00080000:1.0:1787784523.786098:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787784523.786132:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94319746e100) 00010000:00010000:1.0:1787784523.786135:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787784523.786144:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb0dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aac4 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784523.786265:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac780c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:10554:x1874627634710656:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 15174us (15475us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787784523.786275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000020:00080000:1.0:1787784523.786279:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787784523.790227:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784523.794838:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634710912 00000100:00100000:2.0:1787784523.794862:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634710912 00000100:00100000:2.0:1787784523.797342:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:2.0:1787784523.797401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:10554:x1874627634710912:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784523.797435:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784523.797471:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb0f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aacb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.797556:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aacb expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.797573:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aacb expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.797604:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784523.797626:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784523.797632:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501a00, rc 0) 00000100:00100000:2.0:1787784523.797731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+46:10554:x1874627634710912:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 374us (7516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.797742:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:0.0:1787784523.811037:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784523.811156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634711168 00000100:00100000:2.0:1787784523.811168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634711168 00000100:00100000:2.0:1787784523.811229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1787784523.811240:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+46:10554:x1874627634711168:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784523.811560:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:10554:x1874627634711168:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 322us (533us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787784523.811569:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:3.0:1787784523.913743:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784523.913849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634711296 00000100:00100000:0.0:1787784523.913859:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634711296 00000100:00100000:0.0:1787784523.913921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:0.0:1787784523.913932:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190447c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:10564:x1874627634711296:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1787784523.914015:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914034:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914060:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914087:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914094:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914198:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914207:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914234:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784523.914283:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914297:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914317:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914326:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914333:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784523.914337:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914346:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914358:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784523.914361:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784523.914438:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914446:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914461:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914474:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914479:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914484:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784523.914487:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914494:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914502:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdce00) 00010000:00010000:0.0:1787784523.914505:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784523.914508:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914513:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914531:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914537:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914543:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914547:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784523.914557:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914563:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914571:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784523.914573:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784523.914575:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784523.914581:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb10d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784523.914670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190447c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:10564:x1874627634711296:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 739us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784523.914679:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:0.0:1787784523.970912:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784523.971136:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634711552 00000100:00100000:3.0:1787784523.971146:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634711552 00000100:00100000:3.0:1787784523.971210:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:3.0:1787784523.971221:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:10567:x1874627634711552:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784523.971262:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784523.971282:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aad2 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971399:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971415:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971427:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971443:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971450:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971457:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971621:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971629:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971636:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784523.971647:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787784523.971758:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971767:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971775:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971782:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784523.971787:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971795:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971808:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:3.0:1787784523.971811:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784523.971817:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971824:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb11b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971839:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971845:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971852:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971857:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784523.971866:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971873:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971881:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94319746e000) 00010000:00010000:3.0:1787784523.971884:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784523.971887:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971893:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971934:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad2 expref: 50 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971948:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad2 expref: 49 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784523.971956:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:3.0:1787784523.971970:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784523.971973:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610400, rc 0) 00000100:00100000:3.0:1787784523.972280:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:10567:x1874627634711552:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1058us (1376us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787784523.972289:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1787784523.977878:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784523.978114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634711680 00000100:00100000:2.0:1787784523.978125:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634711680 00000100:00100000:2.0:1787784523.978224:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:2.0:1787784523.978235:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192069e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:10567:x1874627634711680:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1787784523.978321:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978343:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978416:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978424:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978447:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978453:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784523.978458:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978466:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978480:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784523.978483:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784523.978488:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784523.978496:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784523.978580:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192069e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:10567:x1874627634711680:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 347us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784523.978599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:3.0:1787784523.981355:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784523.981803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634711936 00000100:00100000:1.0:1787784523.981815:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634711936 00000100:00100000:1.0:1787784523.981879:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1787784523.981889:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:10567:x1874627634711936:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784523.982291:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:10567:x1874627634711936:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 403us (949us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787784523.982313:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:3.0:1787784524.081746:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.081948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634712192 00000100:00100000:2.0:1787784524.081967:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634712192 00000100:00100000:2.0:1787784524.082069:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00100000:2.0:1787784524.082081:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:10577:x1874627634712192:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784524.082105:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.082108:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784524.082136:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aab6 expref: 50 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784524.082182:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784524.082196:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb13e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aad9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082579:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082612:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082625:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784524.082639:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787784524.082780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb13e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad9 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082797:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad9 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.082805:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.082808:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784524.082810:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501200, rc 0) 00000100:00100000:2.0:1787784524.082926:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:10577:x1874627634712192:12345-192.168.202.59@tcp:101:bash.0 Request processed in 846us (1192us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787784524.082935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00080000:3.0:1787784524.083429:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784524.085771:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643120512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.085846:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.085916:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784524.085922:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643120640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.085946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.085999:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120512 00000100:00100000:0.0:1787784524.086007:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120512 00000100:00100000:0.0:1787784524.086062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120640 00000100:00100000:0.0:1787784524.086065:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120640 00000100:00100000:0.0:1787784524.086101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784524.086109:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643120512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.086157:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643120512:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.086177:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787784524.086197:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787784524.086203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643120640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.086234:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643120640:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.086241:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1787784524.086258:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784524.086287:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643120640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.086309:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643120512:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.086591:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643120768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.086649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.086679:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787784524.086685:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643120384:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.086713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.086738:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643120896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.086758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784524.086899:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120384 00000100:00100000:2.0:1787784524.086905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120384 00000100:00100000:2.0:1787784524.086948:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787784524.086956:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643120384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784524.086995:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643120384:12345-0@lo:400:kworker.0 Request processed in 41us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.087002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787784524.087031:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120896 00000100:00100000:2.0:1787784524.087035:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120896 00000100:00100000:2.0:1787784524.087077:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787784524.087083:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784524.087111:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643120896:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.087117:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1787784524.087326:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784524.087339:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643120768 00000100:00100000:0.0:1787784524.087343:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643120768 00000100:00100000:0.0:1787784524.087396:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784524.087404:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1874627643120768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784524.087442:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3295:x1874627643120768:12345-0@lo:400:kworker.0 Request processed in 40us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.087448:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787784524.087463:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784524.087617:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643120384:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.087631:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643120896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784524.087641:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643120768:0@lo:400:kworker.0 00000100:00100000:1.0:1787784524.098225:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.098341:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634712448 00000100:00100000:0.0:1787784524.098352:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634712448 00000100:00100000:0.0:1787784524.098624:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 105 00000100:00100000:0.0:1787784524.098637:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431920683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:10577:x1874627634712448:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:0.0:1787784524.098708:0:8617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787784524.098737:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad9 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.098785:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aad2 expref: 50 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.098797:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784524.098802:0:8617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784524.099341:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.099359:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.099428:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784524.099492:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787784524.099516:0:8617:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002e8ddea reply state 000000005c08c326 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.099525:0:8617:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784524.099981:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431920683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:10577:x1874627634712448:12345-192.168.202.59@tcp:36:bash.0 Request processed in 1343us (1763us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787784524.099990:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 105 00000020:00080000:0.0:1787784524.099996:0:8617:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784524.104455:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1787784524.104526:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104539:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104547:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104553:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784524.104557:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104565:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104620:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.104623:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784524.104628:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104635:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.104679:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634712576 00000100:00100000:2.0:1787784524.104689:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634712576 00000100:00100000:2.0:1787784524.104736:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:2.0:1787784524.104745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:10577:x1874627634712576:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784524.104769:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.104786:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb15a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aae0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104865:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104879:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104889:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784524.104921:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787784524.104926:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784524.104948:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.104997:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb15a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.105011:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.105019:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.105022:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784524.105024:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501800, rc 0) 00000100:00100000:2.0:1787784524.106317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:10577:x1874627634712576:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1555us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.106328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:2.0:1787784524.114395:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784524.114544:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634712832 00000100:00100000:1.0:1787784524.114555:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634712832 00000100:00100000:1.0:1787784524.114627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1787784524.114637:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:10577:x1874627634712832:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:1.0:1787784524.114904:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+53:10577:x1874627634712832:12345-192.168.202.59@tcp:35:bash.0 Request processed in 267us (518us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787784524.114912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:2.0:1787784524.182415:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.182501:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634712960 00000100:00100000:0.0:1787784524.182510:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634712960 00000100:00100000:0.0:1787784524.182571:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:0.0:1787784524.182581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+53:10583:x1874627634712960:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784524.182625:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784524.182658:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aae7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182722:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182736:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182750:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784524.182814:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787784524.182817:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784524.182838:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182863:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae7 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182883:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae7 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.182891:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:0.0:1787784524.182894:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784524.182897:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88c00, rc 0) 00000100:00100000:0.0:1787784524.182959:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634712960:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 379us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.182966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:0.0:1787784524.194622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784524.194774:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713088 00000100:00100000:1.0:1787784524.194786:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713088 00000100:00100000:1.0:1787784524.194853:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:1.0:1787784524.194864:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634713088:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784524.194884:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784524.194907:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aaee expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.194975:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.194990:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195003:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195018:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195025:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195032:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195157:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195165:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195184:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784524.195227:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787784524.195232:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784524.195250:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195263:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195271:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195278:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195285:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195292:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784524.195296:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195304:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195317:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784524.195321:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784524.195326:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195343:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb17d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195361:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195432:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195440:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195445:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784524.195448:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195455:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195462:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943190486b00) 00010000:00010000:1.0:1787784524.195465:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784524.195467:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195473:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195506:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195518:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 55 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.195532:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784524.195534:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784524.195537:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784524.195599:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10583:x1874627634713088:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 736us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.195619:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:1.0:1787784524.200220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.200312:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713344 00000100:00100000:2.0:1787784524.200321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713344 00000100:00100000:2.0:1787784524.200412:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:2.0:1787784524.200422:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10583:x1874627634713344:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784524.200444:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.200465:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aaf5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200569:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200595:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200623:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200634:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200673:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200688:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.200703:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643121024:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784524.200804:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.200814:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.200824:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643121152:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784524.200846:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185755c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784524.204259:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:0.0:1787784524.204924:0:5833:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.59@tcp) returned -22 from blocking AST (req@00000000036c3f3e x1874627643121024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.204949:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.204974:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb18b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaee expref: 56 pid: 8617 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.204989:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643121024:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784524.208823:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713472 00000100:00100000:3.0:1787784524.208838:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713472 00000100:00100000:3.0:1787784524.208949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784524.208960:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:2363:x1874627634713472:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784524.208976:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784524.208979:0:5816:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ffb8d925c20bb18b) 00010000:00010000:3.0:1787784524.208982:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784524.209543:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:2363:x1874627634713472:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 583us (5292us total) trans 0 rc 116/116 00000100:00100000:3.0:1787784524.209552:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1787784524.210219:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643121152:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784524.210246:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.210253:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.210280:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.210290:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.211185:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.211514:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713600 00000100:00100000:3.0:1787784524.211523:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713600 00010000:00010000:3.0:1787784524.211556:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.211835:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1787784524.211846:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:2365:x1874627634713600:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784524.211862:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784524.211870:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211884:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211907:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aae0 expref: 56 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211924:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:3.0:1787784524.211929:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211939:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211946:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.211978:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784524.212046:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:2365:x1874627634713600:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 194us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.212054:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00010000:00010000:2.0:1787784524.212345:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.212354:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784524.212395:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787784524.212556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.212572:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.212582:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.212585:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784524.212600:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784524.212859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10583:x1874627634713344:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 12438us (12649us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787784524.212867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:0.0:1787784524.216198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.216274:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713856 00000100:00100000:2.0:1787784524.216283:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713856 00000100:00100000:2.0:1787784524.216436:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784524.216447:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10583:x1874627634713856:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:2.0:1787784524.216478:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784524.216506:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb0f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aacb expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.216526:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.216531:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784524.217342:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634713856:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 156us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.217359:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1787784524.219416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.219501:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634713984 00000100:00100000:3.0:1787784524.219525:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634713984 00000100:00100000:3.0:1787784524.219582:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:3.0:1787784524.219716:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634713984:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:3.0:1787784524.219849:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.219868:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.219879:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784524.220100:0:8618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787784524.220262:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634713984:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 550us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.220272:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:0.0:1787784524.223360:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.223754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634714112 00000100:00100000:2.0:1787784524.223765:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634714112 00000100:00100000:2.0:1787784524.223861:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:2.0:1787784524.223872:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:10583:x1874627634714112:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784524.223893:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.223915:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aafc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.223978:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.223991:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.224011:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.224024:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.224075:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.224079:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784524.224084:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.224092:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501a00, rc 0) 00000100:00100000:2.0:1787784524.224156:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10583:x1874627634714112:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 286us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.224164:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 111 00010000:00010000:3.0:1787784524.404497:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787784524.596993:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784524.597003:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784524.597056:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787784524.597063:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784524.597204:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190446d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643121280:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784524.597316:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885af3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784524.600899:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643121408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784524.600985:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784524.604549:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643121408 00000100:00100000:0.0:1787784524.604573:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643121408 00000100:00100000:0.0:1787784524.604681:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787784524.604695:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643121408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784524.604732:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784524.607974:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643121408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3272us (6978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.607990:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784524.612021:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190446d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643121280:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787784524.620153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784524.623098:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643121408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784524.625150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634714240 00000100:00100000:2.0:1787784524.625170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634714240 00000100:00100000:2.0:1787784524.625279:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:2.0:1787784524.625289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10584:x1874627634714240:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784524.625326:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784524.625797:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10584:x1874627634714240:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 507us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.625806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:0.0:1787784524.639817:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784524.639905:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634714368 00000100:00100000:1.0:1787784524.639917:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634714368 00000100:00100000:1.0:1787784524.639985:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:1.0:1787784524.639995:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10584:x1874627634714368:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787784524.640080:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640097:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640108:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640146:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640173:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640180:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640204:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640211:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640217:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784524.640260:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787784524.640263:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784524.640275:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640286:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640292:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640299:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640306:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784524.640310:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640323:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640336:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:1.0:1787784524.640338:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784524.640342:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640349:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb1b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640416:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640423:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640430:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640435:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784524.640438:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640452:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640459:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff943190486b00) 00010000:00010000:1.0:1787784524.640461:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784524.640464:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640479:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb1bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640496:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640502:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640507:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640512:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784524.640515:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640520:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640528:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784524.640530:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784524.640534:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.640540:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb1c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.642179:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10584:x1874627634714368:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 2174us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.642194:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:0.0:1787784524.651854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.651947:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634714624 00000100:00100000:2.0:1787784524.651967:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634714624 00000100:00100000:2.0:1787784524.652031:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:2.0:1787784524.652051:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:10584:x1874627634714624:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.652073:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.652095:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab03 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652234:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652252:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652265:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784524.652277:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787784524.652453:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652462:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652470:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652477:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784524.652481:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652490:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652503:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784524.652506:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784524.652511:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652530:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652574:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab03 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:2.0:1787784524.652588:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784524.652592:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab03 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.652603:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:2.0:1787784524.653353:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634714624:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1299us (1507us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787784524.653576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:0.0:1787784524.675230:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.675399:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634714752 00000100:00100000:3.0:1787784524.675412:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634714752 00000100:00100000:3.0:1787784524.675476:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:3.0:1787784524.675487:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634714752:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787784524.675544:0:8618:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787784524.675667:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634714752:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 181us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.675674:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:0.0:1787784524.689197:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.689420:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715008 00000100:00100000:2.0:1787784524.689431:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715008 00000100:00100000:2.0:1787784524.689492:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:2.0:1787784524.689501:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634715008:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.689525:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.689528:0:8617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784524.689559:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aae7 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.689579:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784524.689583:0:8617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784524.689614:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab0a expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784524.690111:0:8617:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787784524.690450:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.690466:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.690476:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.690539:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab0a expref: 58 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.690554:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab0a expref: 57 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.690562:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183923700) 00010000:00010000:2.0:1787784524.690565:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784524.690567:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500000, rc 0) 00000100:00100000:2.0:1787784524.690635:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:10584:x1874627634715008:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1135us (1449us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787784524.690644:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:1.0:1787784524.703904:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.704014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715264 00000100:00100000:2.0:1787784524.704025:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715264 00000100:00100000:2.0:1787784524.704118:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:2.0:1787784524.704128:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:10584:x1874627634715264:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.704234:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784524.704269:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb1e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab0a expref: 57 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704289:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183923700) 00010000:00010000:2.0:1787784524.704314:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784524.704341:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704357:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704424:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704485:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704494:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704501:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704587:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704595:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704602:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704613:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784524.704617:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704624:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704633:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784524.704635:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784524.704640:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704645:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb1f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704655:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704661:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704666:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704671:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784524.704673:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704679:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704698:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1595c6c7 (ffff943183923b00) 00010000:00010000:2.0:1787784524.704700:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784524.704703:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.704709:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb1fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1595c6c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.704803:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192068780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634715264:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 675us (908us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784524.704811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:1.0:1787784524.719690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.719826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715392 00000100:00100000:0.0:1787784524.719836:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715392 00000100:00100000:0.0:1787784524.719922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:0.0:1787784524.719934:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:10584:x1874627634715392:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784524.719958:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784524.719980:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab11 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720028:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720052:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720064:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720177:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720195:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.720203:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:0.0:1787784524.720206:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784524.720209:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784524.720274:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:10584:x1874627634715392:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 343us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.720282:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:1.0:1787784524.736347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.736562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715648 00000100:00100000:0.0:1787784524.736574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715648 00000100:00100000:0.0:1787784524.736664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:0.0:1787784524.736675:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:10584:x1874627634715648:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784524.736784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.736805:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.736819:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784524.737128:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787784524.737138:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339563772690ns, next at 340563769818ns, rc = 0 00000004:00010000:0.0:1787784524.737233:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ba41405 reply state 0000000093bd96be transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.737243:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784524.737354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:10584:x1874627634715648:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 680us (1018us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787784524.737361:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00010000:00010000:3.0:1787784524.741078:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741098:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741107:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741114:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784524.741120:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741129:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741146:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:3.0:1787784524.741150:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784524.741155:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.741162:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.743636:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.744976:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715776 00000100:00100000:3.0:1787784524.744997:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715776 00000100:00100000:3.0:1787784524.745145:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:3.0:1787784524.745176:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:10584:x1874627634715776:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784524.745203:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784524.745224:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab18 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.745305:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.745322:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.745343:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:3.0:1787784524.745347:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784524.745351:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610a00, rc 0) 00000100:00100000:3.0:1787784524.745565:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:10584:x1874627634715776:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 392us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.745573:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:1.0:1787784524.751529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.751712:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634715904 00000100:00100000:2.0:1787784524.751723:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634715904 00000100:00100000:2.0:1787784524.751826:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:2.0:1787784524.751837:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634715904:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787784524.752190:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634715904:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 354us (671us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787784524.752199:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784524.755466:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.755697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634716160 00000100:00100000:2.0:1787784524.755707:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634716160 00000100:00100000:2.0:1787784524.755768:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784524.755778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:10584:x1874627634716160:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784524.756045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:10584:x1874627634716160:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 267us (598us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787784524.756054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784524.759349:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.759772:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634716416 00000100:00100000:2.0:1787784524.759796:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634716416 00000100:00100000:2.0:1787784524.759858:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:2.0:1787784524.759869:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:10584:x1874627634716416:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784524.759986:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:10584:x1874627634716416:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 117us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.759994:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:1.0:1787784524.762936:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.763126:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634716544 00000100:00100000:2.0:1787784524.763136:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634716544 00000100:00100000:2.0:1787784524.763197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:2.0:1787784524.763208:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:10584:x1874627634716544:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.763227:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.763249:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb21e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab1f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763773:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763790:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763802:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784524.763843:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784524.763862:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763890:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb21e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab1f expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763930:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab1f expref: 61 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.763939:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:2.0:1787784524.763942:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787784524.763945:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:2.0:1787784524.764059:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:10584:x1874627634716544:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 851us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.764067:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:1.0:1787784524.775854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.776006:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634716672 00000100:00100000:0.0:1787784524.776017:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634716672 00000100:00100000:0.0:1787784524.776185:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1787784524.776196:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634716672:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784524.776216:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784524.776239:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab26 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784524.776301:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6d4d, blocks: 0x1 00010000:00010000:0.0:1787784524.776324:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787784524.776328:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784524.776338:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.776355:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.776407:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784524.776464:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2363:x1874627634716672:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 270us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.776472:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1787784524.779019:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.779361:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634716928 00000100:00100000:3.0:1787784524.779493:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634716928 00000100:00100000:2.0:1787784524.779782:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:2.0:1787784524.779794:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:10584:x1874627634716928:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784524.779914:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:10584:x1874627634716928:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 117us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.779922:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:1.0:1787784524.787411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.787506:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717056 00000100:00100000:2.0:1787784524.787515:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717056 00000100:00100000:2.0:1787784524.787573:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1787784524.787584:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:10584:x1874627634717056:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.787603:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784524.787621:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab2d expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.787658:0:8198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.787699:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784524.787704:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784524.787711:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 11 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.787745:0:8198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.787760:0:8198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 11 pid: 6679 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.787774:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8198:1874627643121536:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784524.787867:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784524.796605:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.796847:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717184 00000100:00100000:0.0:1787784524.796857:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717184 00010000:00010000:0.0:1787784524.796907:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 12 pid: 6679 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.796949:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1787784524.796959:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2363:x1874627634717184:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784524.796974:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784524.797000:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 12 pid: 6679 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.797044:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 12 pid: 6679 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.797075:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784524.797081:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784524.797090:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 12 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.797110:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 12 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.797151:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 12 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.797166:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f04780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643121664:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784524.797249:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9ab40 going to sleep for 11 seconds 00010000:00010000:2.0:1787784524.798139:0:8198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb22c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab26 expref: 12 pid: 6679 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.798164:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8198:1874627643121536:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784524.798191:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 11 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.798203:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501600, rc 0) 00000100:00100000:2.0:1787784524.798253:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:10584:x1874627634717056:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 10670us (10851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784524.798284:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:0.0:1787784524.800779:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f04780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643121664:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784524.800808:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784524.800867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2363:x1874627634717184:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 3909us (4283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.800879:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1787784524.805565:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.807494:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717312 00000100:00100000:2.0:1787784524.807508:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717312 00002000:00100000:2.0:1787784524.807565:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9431b9f04780 x1874627634717312/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:405/0 lens 504/0 e 0 to 0 dl 1787784535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784524.807577:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9f04780 with x1874627634717312 ext(0->12) 00002000:00010000:2.0:1787784524.808085:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9f04780 00000100:00100000:2.0:1787784524.808237:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784524.808249:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2363:x1874627634717312:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787784524.809010:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2363:x1874627634717312:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 760us (3453us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787784524.809020:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00002000:00100000:2.0:1787784524.809028:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9431b9f04780 x1874627634717312/t4294967308(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:405/0 lens 504/448 e 0 to 0 dl 1787784535 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784524.809067:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9f04780 with x1874627634717312 ext(0->12) 00002000:00010000:2.0:1787784524.809072:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9f04780 00000100:00100000:3.0:1787784524.821309:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.821525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717440 00000100:00100000:0.0:1787784524.821538:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717440 00000100:00100000:0.0:1787784524.821626:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:0.0:1787784524.821637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:10584:x1874627634717440:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787784524.869543:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787784524.869558:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787784524.869592:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431887ef600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787784524.869597:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943183081700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9431887efb40 00000020:00080000:1.0:1787784524.869600:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943183081400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff943184c8e400 00000004:00080000:1.0:1787784524.869625:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787784524.869644:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431963b4780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787784524.869647:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943185660500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9431961aa780 00000020:00080000:1.0:1787784524.869650:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff943185660800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431bf656000 00000004:00080000:1.0:1787784524.869667:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:1.0:1787784524.869685:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1787784524.869734:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787784524.869907:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787784524.870050:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10584:x1874627634717440:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 48397us (48735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.870061:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:3.0:1787784524.870663:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784524.870681:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943190444780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643121792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787784524.870734:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.870794:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784524.870803:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431904470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643121920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784524.870827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784524.870855:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643121792 00000100:00100000:3.0:1787784524.870870:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643121792 00000100:00100000:3.0:1787784524.870904:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643121920 00000100:00100000:3.0:1787784524.870908:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643121920 00000100:00100000:3.0:1787784524.870927:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784524.870934:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643121792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787784524.870957:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1787784524.870981:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.871002:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.871012:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787784524.871017:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784524.871021:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.871144:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.871159:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 11 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.871170:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643122048:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784524.871218:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784524.871235:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787784524.871243:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1874627643121920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787784524.871410:0:8198:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787784524.871414:0:8198:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787784525 00002000:00010000:3.0:1787784524.871417:0:8198:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787784524.871418:0:8198:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787784525 -> 1787784525 00002000:00010000:3.0:1787784524.871421:0:8198:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787784524.871459:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1874627643121920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (631us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787784524.871466:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1787784524.871572:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9431904470c0/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787784524.871578:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431904470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643121920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787784524.872096:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784524.872117:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643122176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787784524.872150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784524.872264:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643122176 00000100:00100000:2.0:1787784524.872269:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643122176 00000100:00100000:2.0:1787784524.872304:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787784524.872311:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1874627643122176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787784524.872327:0:8198:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787784524.872350:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f6d4b, atime: 0x6a8f6d4c, ctime: 0x6a8f6d4b, blocks: 0x1 00010000:00010000:2.0:1787784524.872357:0:8198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.872403:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1787784524.872407:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784524.872413:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.872430:0:8198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.872440:0:8198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.872447:0:8198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.872462:0:8198:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784524.872931:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643122176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 619us (779us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787784524.872941:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787784524.872977:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943187f9e1c0/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787784524.872983:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643122176:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787784524.873740:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784524.873750:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.873763:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784524.873768:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.873779:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.873798:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.873807:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000883f57c2/0xffb8d925c20bb241 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.873845:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.873847:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784524.873849:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784524.879393:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.879431:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784524.879597:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717568 00000100:00100000:1.0:1787784524.879607:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717568 00010000:00010000:1.0:1787784524.879654:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 12 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784524.879695:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:1.0:1787784524.879706:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2362:x1874627634717568:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784524.879723:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784524.879729:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 12 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.879746:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 12 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.879774:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784524.879779:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784524.879786:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.879797:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784524.879818:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784524.879869:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2362:x1874627634717568:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 165us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784524.879877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00010000:00010000:3.0:1787784524.880313:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ccc96b/0xffb8d925c20baffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.59@tcp remote: 0x845202732849aa8c expref: 11 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.880331:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431904452c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643122048:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784524.880356:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.880402:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.880410:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.880419:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.880427:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.880443:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787784524.881094:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3293:x1874627643121792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10158us (10358us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787784524.881187:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784524.881208:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717696 00000100:00100000:3.0:1787784524.881213:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717696 00000100:00100000:3.0:1787784524.881245:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1787784524.881252:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:2362:x1874627634717696:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787784524.881615:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943190444780/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787784524.881624:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943190444780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643121792:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787784524.882275:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784524.882286:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.882299:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784524.882305:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.882316:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.882336:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.882345:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005098438c/0xffb8d925c20bb23a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.882391:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784524.882393:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784524.882395:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787784524.950834:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1787784524.950860:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787784524.950872:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787784524.950889:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1787784524.951118:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634717696:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 69859us (71679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784524.951131:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:0.0:1787784524.962358:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784524.965856:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634717952 00000100:00100000:2.0:1787784524.965893:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634717952 00000100:00100000:2.0:1787784524.965969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:2.0:1787784524.965981:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10584:x1874627634717952:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784524.966045:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784524.966073:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab1f expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.966095:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:2.0:1787784524.966100:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784524.966132:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.966147:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784524.966158:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784524.966471:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aca17733 reply state 00000000c554f277 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784524.966482:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784524.966606:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:10584:x1874627634717952:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 626us (4279us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787784524.966614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00010000:00010000:0.0:1787784524.969015:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969041:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969050:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969056:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784524.969061:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969070:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969086:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:0.0:1787784524.969089:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784524.969094:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.969108:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.977829:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.977957:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718080 00000100:00100000:3.0:1787784524.977967:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718080 00000100:00100000:3.0:1787784524.978041:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1787784524.978051:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634718080:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787784524.978313:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787784524.978317:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787784525 -> 1787784524 00002000:00010000:3.0:1787784524.978320:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787784524 00002000:00010000:3.0:1787784524.978322:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787784525 -> 1787784524 00002000:00010000:3.0:1787784524.978325:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787784524.978441:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634718080:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 391us (623us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787784524.978449:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:2.0:1787784524.985621:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784524.985769:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718336 00000100:00100000:0.0:1787784524.985779:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718336 00000100:00100000:0.0:1787784524.985848:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:0.0:1787784524.985875:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:10584:x1874627634718336:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787784524.985961:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.985993:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.986009:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.986078:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.986100:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 15 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.986119:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643122304:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784524.986247:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4417a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784524.992053:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784524.992143:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718464 00000100:00100000:3.0:1787784524.992153:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718464 00010000:00010000:3.0:1787784524.992193:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 16 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.992283:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:3.0:1787784524.992302:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:2363:x1874627634718464:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784524.992318:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784524.992325:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 16 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.992338:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 16 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.992418:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:3.0:1787784524.992425:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992433:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab11 expref: 16 pid: 5832 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.992436:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784524.992455:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.992467:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643122304:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784524.992479:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784524.992494:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992507:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992527:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784524.992532:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:2363:x1874627634718464:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 231us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784524.992544:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00010000:00010000:0.0:1787784524.992567:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992588:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992596:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.992602:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784524.994773:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.994788:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.994806:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:0.0:1787784524.994809:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787784524.994814:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784524.994820:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb24f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784524.994936:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10584:x1874627634718336:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 9059us (9321us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787784524.994946:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:1.0:1787784525.002226:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784525.002328:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718592 00000100:00100000:2.0:1787784525.002337:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718592 00000100:00100000:2.0:1787784525.002460:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:2.0:1787784525.002470:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634718592:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787784525.002529:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.002549:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.002557:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784525.002561:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787784525.002565:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.002609:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.002623:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 7 pid: 8198 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784525.002638:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943187f9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874627643122432:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784525.002727:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549dc00 going to sleep for 11 seconds 00000100:00080000:0.0:1787784525.002799:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784525.006953:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943187f9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874627643122432:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784525.006984:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784525.012085:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.012198:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718720 00000100:00100000:3.0:1787784525.012208:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718720 00010000:00010000:3.0:1787784525.012257:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 8 pid: 8198 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784525.012320:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:3.0:1787784525.012331:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634718720:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784525.012423:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784525.012452:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 8 pid: 8198 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.012468:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 8 pid: 8198 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.012494:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bb233 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab2d expref: 8 pid: 8198 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.012513:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784525.012517:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784525.012522:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.012532:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.012570:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784525.012642:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012665:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012694:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012702:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012711:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012717:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784525.012721:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012730:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012741:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.012750:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000883f57c2/0xffb8d925c20bb256 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784525.012828:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634718592:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 10359us (10613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784525.012837:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1787784525.012919:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634718720:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 302us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784525.012929:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:3.0:1787784525.021973:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784525.023612:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634718976 00000100:00100000:1.0:1787784525.023625:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634718976 00000100:00100000:1.0:1787784525.023711:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:1.0:1787784525.023723:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10584:x1874627634718976:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784525.023812:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.023832:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.023844:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.024079:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.024090:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.024098:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.024132:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.024145:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 15 pid: 8618 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784525.024178:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643122560:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784525.024285:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784525.026886:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.027750:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634719104 00000100:00100000:3.0:1787784525.027761:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634719104 00010000:00010000:3.0:1787784525.027805:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 16 pid: 8618 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784525.027866:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:3.0:1787784525.027874:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:2362:x1874627634719104:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784525.027890:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784525.027896:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 16 pid: 8618 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.027908:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 16 pid: 8618 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.027931:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:3.0:1787784525.027937:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.027946:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.027954:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.027976:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784525.028046:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+16:2362:x1874627634719104:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 172us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784525.028054:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00010000:00010000:1.0:1787784525.028541:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab18 expref: 15 pid: 8618 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784525.028559:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643122560:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784525.028579:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.028588:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.028593:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787784525.029051:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787784525.029207:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787784525.029250:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787784525.029331:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1874627643122688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787784525.029437:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.029462:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784525.029982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643122688 00000100:00100000:0.0:1787784525.029989:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643122688 00000100:00100000:0.0:1787784525.030050:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784525.030060:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874627643122688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787784525.030146:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874627643122688:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.030154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784525.032190:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787784525.032202:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787784525.032224:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9431904470c0, transno 4294967309 00000004:00080000:1.0:1787784525.032239:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943190444780, transno 4294967310 00000100:00100000:1.0:1787784525.032248:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1874627643122688:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787784525.035108:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787784525.035210:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1874627643122816:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787784525.035279:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784525.035320:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784525.035872:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643122816 00000100:00100000:0.0:1787784525.035882:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643122816 00000100:00100000:0.0:1787784525.035944:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784525.035954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874627643122816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787784525.036219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874627643122816:12345-0@lo:1000:mdt00_002.0 Request processed in 266us (938us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787784525.036228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784525.037777:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1874627643122816:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787784525.037839:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037851:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037858:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037864:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784525.037870:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037878:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037895:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943183fdce00) 00010000:00010000:1.0:1787784525.037898:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784525.037903:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037909:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb264 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037942:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037965:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037971:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037976:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784525.037979:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037986:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.037996:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784525.037999:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784525.038006:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.038017:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.038027:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.039056:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784525.039073:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643122944:192.168.202.59@tcp:105: 00000100:00100000:1.0:1787784525.039239:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b9efde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784525.052427:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784525.052901:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643122944:192.168.202.59@tcp:105: 00010000:00010000:1.0:1787784525.052932:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.052943:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb1a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.052978:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.052994:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053007:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053017:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053023:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053040:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053047:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784525.053051:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053058:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053092:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784525.053095:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784525.053099:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053106:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb26b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053119:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053125:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053130:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053136:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784525.053138:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053143:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053150:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784525.053153:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784525.053155:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.053161:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb25d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784525.053463:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10584:x1874627634718976:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 29740us (31498us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787784525.053473:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000020:00080000:1.0:1787784525.053480:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787784525.054238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634719232 00000100:00100000:2.0:1787784525.054247:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634719232 00000100:00100000:2.0:1787784525.054320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1787784525.054331:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10583:x1874627634719232:12345-192.168.202.59@tcp:49:lfs.0 00000100:00100000:2.0:1787784525.054493:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10583:x1874627634719232:12345-192.168.202.59@tcp:49:lfs.0 Request processed in 164us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784525.054500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000040:00080000:3.0:1787784525.059531:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784525.059541:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784525.060126:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787784525.060135:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787784525.066335:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784525.066401:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784525.066430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634719488 00000100:00100000:1.0:1787784525.066441:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634719488 00000100:00100000:1.0:1787784525.066508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1787784525.066519:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac782850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:10584:x1874627634719488:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784525.066591:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634719744 00000100:00100000:3.0:1787784525.066596:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634719744 00000100:00100000:3.0:1787784525.066636:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:3.0:1787784525.066644:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:10583:x1874627634719744:12345-192.168.202.59@tcp:58:lfs.0 00000040:00080000:3.0:1787784525.067213:0:8617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787784525.067355:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10583:x1874627634719744:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 711us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784525.067395:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 128 00000004:00080000:1.0:1787784525.067547:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787784525.068216:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787784525.068270:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068352:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068457:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068465:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068472:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068478:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784525.068501:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787784525.068759:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac782850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10584:x1874627634719488:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 2239us (2432us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787784525.068769:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000020:00080000:1.0:1787784525.068774:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787784525.068802:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784525.068811:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.068821:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784525.068826:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.068835:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.068850:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff943190486b00) 00010000:00010000:3.0:1787784525.068854:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787784525.068858:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.068864:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb272 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784525.068883:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784525.068885:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784525.068886:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784525.110119:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784525.110228:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634719872 00000100:00100000:0.0:1787784525.110241:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634719872 00000100:00100000:0.0:1787784525.110315:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 129 00000100:00100000:0.0:1787784525.110327:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:10586:x1874627634719872:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784525.110354:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784525.110423:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab34 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110497:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110529:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110542:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110559:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110567:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110572:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110891:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110902:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110912:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110950:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.110964:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 21 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784525.110991:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643123072:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784525.111127:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186893480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784525.118677:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.118965:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720128 00000100:00100000:3.0:1787784525.118991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720128 00000100:00100000:3.0:1787784525.119060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:3.0:1787784525.119071:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:5607:x1874627634720128:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787784525.119339:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:5607:x1874627634720128:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 269us (671us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787784525.119348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1787784525.120878:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643123072:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784525.120911:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784525.122224:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784525.126192:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720256 00000100:00100000:1.0:1787784525.126207:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720256 00010000:00010000:0.0:1787784525.126793:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 23 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784525.126842:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:0.0:1787784525.126853:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:2363:x1874627634720256:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784525.126869:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784525.126875:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 23 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.126889:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 23 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.126913:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aaf5 expref: 23 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.126931:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784525.126935:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.127036:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.127045:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784525.127137:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784525.127210:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2363:x1874627634720256:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 358us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784525.127218:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00010000:00010000:2.0:1787784525.131664:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131685:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784525.131812:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787784525.131817:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784525.131843:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131863:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131874:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131907:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131915:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131921:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784525.131925:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.131933:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132679:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:2.0:1787784525.132686:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784525.132691:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132780:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132809:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132815:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132822:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132827:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784525.132847:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132855:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132865:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff943183fdca00) 00010000:00010000:2.0:1787784525.132868:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784525.132872:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132878:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.132942:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab34 expref: 22 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.133659:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab34 expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784525.133668:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:2.0:1787784525.133671:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784525.133674:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88200, rc 0) 00000100:00100000:2.0:1787784525.133894:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10586:x1874627634719872:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 23566us (23783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784525.133905:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 129 00010000:00010000:2.0:1787784525.429524:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784525.565736:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.565781:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.565820:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.565856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784525.565891:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720512 00000100:00100000:3.0:1787784525.565900:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720512 00000100:00100000:3.0:1787784525.565957:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720640 00000100:00100000:3.0:1787784525.565961:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720640 00000100:00100000:3.0:1787784525.566209:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:3.0:1787784525.566223:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634720512:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784525.566297:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634720512:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 78us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784525.566305:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:3.0:1787784525.566322:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:3.0:1787784525.566328:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634720640:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784525.566349:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634720640:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784525.566355:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00080000:3.0:1787784525.566402:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784525.567271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720768 00000100:00100000:2.0:1787784525.567278:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720768 00000100:00100000:2.0:1787784525.567346:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:2.0:1787784525.567383:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634720768:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:3.0:1787784525.567652:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784525.567859:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634720768:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 496us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784525.567867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:1.0:1787784525.567964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720384 00000100:00100000:1.0:1787784525.567969:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720384 00000100:00100000:1.0:1787784525.568012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 297 00000100:00100000:1.0:1787784525.568020:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634720384:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784525.568061:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634720384:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 43us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784525.568067:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 297 00000040:00080000:3.0:1787784526.072007:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784526.072017:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784526.072068:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787784526.072074:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784526.072203:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643123200:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784526.072303:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186dddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784526.076700:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643123200:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784526.077233:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784526.078135:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634720896 00000100:00100000:1.0:1787784526.078146:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634720896 00000100:00100000:1.0:1787784526.078327:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:1.0:1787784526.078339:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10598:x1874627634720896:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787784526.078400:0:8617:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1787784526.079543:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784526.081737:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10598:x1874627634720896:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 1627us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784526.081756:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:2.0:1787784526.091659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784526.095827:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634721152 00000100:00100000:0.0:1787784526.095840:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634721152 00000100:00100000:0.0:1787784526.095931:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:0.0:1787784526.095950:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:10598:x1874627634721152:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784526.095971:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784526.095991:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab3b expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.096104:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.096118:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.096129:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784526.096140:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787784526.096270:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab3b expref: 24 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.096300:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab3b expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.096309:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784526.096312:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784526.096315:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784526.096740:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10598:x1874627634721152:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 790us (5089us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787784526.096748:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:3.0:1787784526.108836:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784526.108930:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784526.109132:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634721280 00000100:00100000:0.0:1787784526.109143:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634721280 00000100:00100000:0.0:1787784526.109214:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784526.109224:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:2363:x1874627634721280:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784526.109239:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784526.109263:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb29c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab3b expref: 23 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.109280:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784526.109285:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784526.109337:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2363:x1874627634721280:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 114us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.109345:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784526.109632:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634721536 00000100:00100000:1.0:1787784526.109638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634721536 00000100:00100000:1.0:1787784526.109684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:1.0:1787784526.109692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:10598:x1874627634721536:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784526.109771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.109787:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.109799:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110014:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110036:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110044:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110051:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784526.110056:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110065:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110075:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784526.110078:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784526.110082:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.110089:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784526.110223:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10598:x1874627634721536:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 531us (1292us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787784526.110230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 132 00000040:00080000:1.0:1787784526.110344:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784526.110349:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784526.111862:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787784526.111879:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784526.117795:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784526.118086:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634721792 00000100:00100000:3.0:1787784526.118097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634721792 00000100:00100000:3.0:1787784526.118159:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:3.0:1787784526.118169:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:10598:x1874627634721792:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784526.118475:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:10598:x1874627634721792:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 306us (690us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787784526.118483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000040:00080000:3.0:1787784526.192835:0:12096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784526.192843:0:12096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784526.192888:0:12096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787784526.192893:0:12096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784526.380323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784526.380530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722048 00000100:00100000:1.0:1787784526.380540:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722048 00000100:00100000:1.0:1787784526.380613:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:1.0:1787784526.380623:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:10612:x1874627634722048:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784526.380649:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784526.380670:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab42 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.380780:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb2b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.380795:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.380810:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784526.380823:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787784526.380955:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb2b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab42 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.380995:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab42 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784526.381004:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784526.381008:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784526.381011:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784526.381090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10612:x1874627634722048:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 468us (778us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787784526.381098:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:3.0:1787784526.385460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784526.385691:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722176 00000100:00100000:0.0:1787784526.385701:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722176 00000100:00100000:0.0:1787784526.385754:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:0.0:1787784526.385779:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10612:x1874627634722176:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784526.385850:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385866:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385879:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385907:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385914:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385921:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385926:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784526.385930:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385938:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385949:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:0.0:1787784526.385952:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784526.385958:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784526.385965:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784526.386070:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:10612:x1874627634722176:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 292us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784526.386078:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 134 00010000:00010000:3.0:1787784526.453880:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784526.495589:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784526.495735:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722304 00000100:00100000:3.0:1787784526.495745:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722304 00000100:00100000:3.0:1787784526.495819:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1787784526.495830:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634722304:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1787784526.495869:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784526.495891:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000548e01a9/0xffb8d925c20bb2cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab49 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784526.495919:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6d4c, atime: 0x6a8f6d4c, ctime: 0x6a8f6d4c, blocks: 0xb 00010000:00010000:3.0:1787784526.495940:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1787784526.495945:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784526.495967:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000548e01a9/0xffb8d925c20bb2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab49 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784526.495988:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000548e01a9/0xffb8d925c20bb2cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab49 expref: 7 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784526.496340:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611c00, rc 0) 00000100:00100000:3.0:1787784526.496441:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634722304:12345-192.168.202.59@tcp:101:cat.0 Request processed in 612us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784526.496448:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1787784526.499848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784526.499962:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722432 00000100:00100000:2.0:1787784526.499973:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722432 00002000:00100000:2.0:1787784526.500040:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9431b9a9f480 x1874627634722432/t0(0) o3->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:407/0 lens 488/0 e 0 to 0 dl 1787784537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784526.500053:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9a9f480 with x1874627634722432 ext(0->4095) 00002000:00010000:2.0:1787784526.500059:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9a9f480 00000100:00100000:2.0:1787784526.500095:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1787784526.500111:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634722432:12345-192.168.202.59@tcp:3:cat.0 00000100:00100000:2.0:1787784526.500582:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634722432:12345-192.168.202.59@tcp:3:cat.0 Request processed in 477us (743us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787784526.500591:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00002000:00100000:2.0:1787784526.500598:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9431b9a9f480 x1874627634722432/t0(0) o3->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:407/0 lens 488/4536 e 0 to 0 dl 1787784537 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787784526.500608:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b9a9f480 with x1874627634722432 ext(0->4095) 00002000:00010000:2.0:1787784526.500612:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b9a9f480 00000001:00080000:2.0:1787784526.711226:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1787784526.711540:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1787784527.476615:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784527.669316:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784527.669343:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784527.669458:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784527.669838:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123328 00000100:00100000:0.0:1787784527.669845:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123328 00000100:00100000:0.0:1787784527.669905:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784527.669914:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643123328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784527.669953:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787784527.670086:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784527.671165:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643123328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1250us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784527.671172:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787784527.671283:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643123328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787784528.500750:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784529.208988:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643123840:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209107:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209198:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787784529.209205:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643123456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209237:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209276:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643123968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209304:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209339:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643123584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209384:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209402:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643124096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209441:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784529.209446:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643123712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784529.209497:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123840 00000100:00100000:2.0:1787784529.209506:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123840 00000100:00100000:2.0:1787784529.209574:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124096 00000100:00100000:2.0:1787784529.209578:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124096 00000100:00100000:2.0:1787784529.209608:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784529.209619:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643123840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209686:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643123840:12345-0@lo:400:kworker.0 Request processed in 68us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.209694:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787784529.209716:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784529.209722:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643124096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209782:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643124096:12345-0@lo:400:kworker.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.209788:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787784529.209807:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123456 00000100:00100000:2.0:1787784529.209810:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123456 00000100:00100000:2.0:1787784529.209835:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787784529.209841:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643123456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.209870:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643123456:12345-0@lo:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.209876:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787784529.209911:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123968 00000100:00100000:2.0:1787784529.209915:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123968 00000100:00100000:2.0:1787784529.209944:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123584 00000100:00100000:2.0:1787784529.209947:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123584 00000100:00100000:2.0:1787784529.209974:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643123712 00000100:00100000:2.0:1787784529.209977:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643123712 00000100:00100000:2.0:1787784529.210008:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787784529.210015:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210045:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643123968:12345-0@lo:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.210051:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787784529.210062:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787784529.210067:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643123584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210092:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643123584:12345-0@lo:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.210097:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787784529.210106:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787784529.210118:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643123712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210143:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643123712:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784529.210149:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787784529.210181:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784529.210186:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784529.210189:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784529.210245:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643123712:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210258:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197115e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643123584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210270:0:3295:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787784529.210276:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787784529.210302:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943187f9e1c0, transno 4294967304 00000100:00100000:2.0:1787784529.210314:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643124096:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210614:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643123456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210627:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643123968:0@lo:400:kworker.0 00000100:00100000:2.0:1787784529.210640:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643123840:0@lo:400:kworker.0 00000040:00080000:3.0:1787784529.218854:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784529.218867:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784529.218905:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787784529.218912:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787784529.524582:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784529.716870:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784529.716903:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643124224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784529.717011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784529.717260:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124224 00000100:00100000:1.0:1787784529.717272:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124224 00000100:00100000:1.0:1787784529.717351:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787784529.717385:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643124224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784529.717435:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784529.717552:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643124224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 190us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784529.717561:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784529.719580:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643124224:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787784530.363008:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:1.0:1787784530.363031:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787784530.363058:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431b9efdf00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787784530.363064:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bef8f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9431b9efd540 00000020:00080000:1.0:1787784530.363088:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bef8ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431bf65e000 00000020:00080000:1.0:1787784530.363118:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787784530.366873:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787784530.367155:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787784530.458908:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1787784530.458934:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787784530.548599:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784530.680156:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784530.680209:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784530.680262:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784530.680292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784530.680326:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784530.680344:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722944 00000100:00100000:0.0:1787784530.680360:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722560 00000100:00100000:3.0:1787784530.680404:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722944 00000100:00100000:0.0:1787784530.680405:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722560 00000100:00100000:3.0:1787784530.680471:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722816 00000100:00100000:3.0:1787784530.680475:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722816 00000100:00100000:3.0:1787784530.680504:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:3.0:1787784530.680516:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634722944:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784530.680615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 299 00000100:00100000:0.0:1787784530.680625:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634722560:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784530.680629:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634722688 00000100:00100000:2.0:1787784530.680634:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634722688 00000100:00100000:2.0:1787784530.680673:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723072 00000100:00100000:2.0:1787784530.680677:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723072 00000100:00100000:2.0:1787784530.680701:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00100000:2.0:1787784530.680709:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2363:x1874627634722688:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784530.680732:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634722944:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 216us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.680743:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:3.0:1787784530.680765:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:3.0:1787784530.680772:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634722816:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784530.685125:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634722560:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 4484us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.685156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 299 00000100:00100000:0.0:1787784530.685513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 161 00000100:00100000:0.0:1787784530.685533:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634723072:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784530.685600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634723072:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 77us (5275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784530.685608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 161 00000100:00100000:2.0:1787784530.686262:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2363:x1874627634722688:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 5548us (6117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784530.686274:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00080000:2.0:1787784530.686360:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784530.686913:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784530.686917:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784530.689393:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634722816:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 8577us (9055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784530.689415:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00010000:00010000:2.0:1787784531.574629:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784531.584269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784531.584502:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723200 00000100:00100000:0.0:1787784531.584516:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723200 00000100:00100000:0.0:1787784531.584614:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00100000:0.0:1787784531.584627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10262:x1874627634723200:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787784531.584783:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10262:x1874627634723200:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 Request processed in 158us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784531.584793:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00100000:2.0:1787784531.588960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784531.589157:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723456 00000100:00100000:3.0:1787784531.589172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723456 00000100:00100000:3.0:1787784531.589263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1787784531.589279:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:10262:x1874627634723456:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784531.592961:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:10262:x1874627634723456:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 3543us (3871us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787784531.593001:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1787784532.011502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784532.011639:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723584 00000100:00100000:2.0:1787784532.011654:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723584 00000100:00100000:2.0:1787784532.011767:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 136 00000100:00100000:2.0:1787784532.011781:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:11064:x1874627634723584:12345-192.168.202.59@tcp:101:lsof.0 00010000:00010000:2.0:1787784532.011809:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784532.011836:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb2d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab50 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.011920:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.011937:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.011952:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787784532.012502:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787784532.012818:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787784532.012824:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784532.012943:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.013441:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb2d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 7 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.013466:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 6 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784532.013476:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:2.0:1787784532.013479:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784532.013483:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:2.0:1787784532.013575:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:11064:x1874627634723584:12345-192.168.202.59@tcp:101:lsof.0 Request processed in 1796us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784532.013584:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 136 00010000:00010000:3.0:1787784532.596576:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784532.790107:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784532.790149:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643124352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784532.790263:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784532.790344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124352 00000100:00100000:0.0:1787784532.790355:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124352 00000100:00100000:0.0:1787784532.790451:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787784532.790467:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643124352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784532.790523:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787784532.790547:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784532.790599:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643124352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784532.790607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787784532.791055:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787784532.791063:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787784532.791099:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643124352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787784533.622443:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784534.324806:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643124608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.324912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.325026:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643125120:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.325099:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784534.325106:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643124736:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.325192:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124608 00000100:00100000:0.0:1787784534.325201:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124608 00000100:00100000:0.0:1787784534.325258:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124736 00000100:00100000:0.0:1787784534.325261:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124736 00000100:00100000:0.0:1787784534.325296:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787784534.325307:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643124608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325394:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643124608:12345-0@lo:400:kworker.0 Request processed in 88us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.325402:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787784534.325424:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787784534.325432:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943192069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643124736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325463:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943192069680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643124736:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.325469:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787784534.325491:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125120 00000100:00100000:0.0:1787784534.325680:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125120 00000100:00100000:0.0:1787784534.325719:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787784534.325727:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643125120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325762:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643125120:12345-0@lo:400:kworker.0 Request processed in 37us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.325769:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787784534.325797:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784534.325810:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784534.325847:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643124736:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325858:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643125120:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325865:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643124608:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.325994:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643124480:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.326030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.326059:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643124992:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.326083:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.326105:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784534.326113:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643124864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.326136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784534.326662:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124864 00000100:00100000:0.0:1787784534.326669:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124864 00000100:00100000:0.0:1787784534.326713:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784534.326721:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643124864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.326771:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643124864:12345-0@lo:400:kworker.0 Request processed in 51us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.326778:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787784534.326798:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124480 00000100:00100000:0.0:1787784534.326801:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124480 00000100:00100000:0.0:1787784534.326828:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787784534.326834:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643124480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.326863:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643124480:12345-0@lo:400:kworker.0 Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.326869:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787784534.326917:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643124992 00000100:00100000:0.0:1787784534.326921:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643124992 00000100:00100000:0.0:1787784534.326961:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787784534.326968:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643124992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784534.327002:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643124992:12345-0@lo:400:kworker.0 Request processed in 35us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784534.327009:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1787784534.327025:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784534.327029:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784534.328640:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643124864:0@lo:400:kworker.0 00000100:00100000:2.0:1787784534.328660:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643124480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784534.328674:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643124992:0@lo:400:kworker.0 00010000:00010000:3.0:1787784534.644617:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784534.837074:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643125248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784534.837197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784534.837690:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125248 00000100:00100000:1.0:1787784534.837703:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125248 00000100:00100000:1.0:1787784534.837792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784534.837805:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643125248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787784534.837854:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784534.837935:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643125248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784534.837953:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787784534.838192:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643125248:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1787784535.390890:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787784535.390928:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787784535.392079:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787784535.392101:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787784535.669981:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784535.809118:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784535.809171:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784535.809208:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784535.809244:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784535.809270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784535.809428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724224 00000100:00100000:3.0:1787784535.809444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724224 00000100:00100000:0.0:1787784535.809448:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723712 00000100:00100000:0.0:1787784535.809463:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723712 00000100:00100000:3.0:1787784535.809522:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723840 00000100:00100000:3.0:1787784535.809528:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723840 00000100:00100000:3.0:1787784535.809556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:3.0:1787784535.809568:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2364:x1874627634724224:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:1.0:1787784535.809638:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784535.809677:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2364:x1874627634724224:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 109us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784535.809694:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:1.0:1787784535.809697:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634723968 00000100:00100000:1.0:1787784535.809705:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634723968 00000100:00100000:3.0:1787784535.809720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:3.0:1787784535.809732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2364:x1874627634723840:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784535.809769:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2364:x1874627634723840:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784535.809770:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724096 00000100:00100000:1.0:1787784535.809778:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724096 00000100:00100000:3.0:1787784535.809783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:1.0:1787784535.809824:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:1.0:1787784535.809860:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634723968:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784535.810050:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:2.0:1787784535.810063:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634724096:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784535.810398:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2364:x1874627634723968:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 513us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784535.810409:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00080000:1.0:1787784535.810439:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784535.810443:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784535.810636:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 301 00000100:00100000:0.0:1787784535.810647:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634723712:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784535.811577:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2364:x1874627634724096:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1511us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784535.811616:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1787784535.814730:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634723712:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 4065us (5602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784535.814751:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 301 00010000:00010000:1.0:1787784536.697289:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784537.550593:0:12302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:48:56 (1787784536) 00010000:00010000:0.0:1787784537.718760:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784537.914540:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784537.914651:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784537.916451:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125376 00000100:00100000:3.0:1787784537.916466:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125376 00000100:00100000:3.0:1787784537.916540:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784537.916550:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643125376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784537.916586:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787784537.916725:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784537.924967:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643125376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8406us (10304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784537.924982:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787784537.928475:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643125376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784538.743501:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784539.444762:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784539.444772:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784539.445271:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787784539.445279:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784539.446150:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643125504:0@lo:400:kworker.0 00000100:00100000:3.0:1787784539.446228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784539.446353:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125504 00000100:00100000:1.0:1787784539.446381:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125504 00000100:00100000:1.0:1787784539.446433:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787784539.446442:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643125504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.446881:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643125888:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.446926:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784539.446969:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643125760:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.446995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784539.447014:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784539.447019:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643125632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784539.447064:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125760 00000100:00100000:2.0:1787784539.447068:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125760 00000100:00100000:2.0:1787784539.447108:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125632 00000100:00100000:2.0:1787784539.447112:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125632 00000100:00100000:2.0:1787784539.447136:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787784539.447142:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643125760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447178:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643125760:12345-0@lo:400:kworker.0 Request processed in 36us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784539.447185:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787784539.447202:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787784539.447207:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643125632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447233:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643125632:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784539.447239:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787784539.447258:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784539.447288:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643125632:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447315:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba3403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643125760:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447354:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643125888 00000100:00100000:2.0:1787784539.447357:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643125888 00000100:00100000:2.0:1787784539.447410:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787784539.447417:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643125888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.447463:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643125888:12345-0@lo:400:kworker.0 Request processed in 46us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784539.447469:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787784539.447483:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784539.447498:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643125888:0@lo:400:kworker.0 00000100:00100000:1.0:1787784539.454019:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3294:x1874627643125504:12345-0@lo:400:kworker.0 Request processed in 7565us (7777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784539.454035:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787784539.456520:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3294:1874627643125504:0@lo:400:kworker.0 00000100:00100000:0.0:1787784539.456887:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784539.456912:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643126144:0@lo:400:kworker.0 00000100:00100000:0.0:1787784539.456975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784539.457061:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784539.457072:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643126016:0@lo:400:kworker.0 00000100:00100000:2.0:1787784539.457102:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784539.457209:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643126144 00000100:00100000:1.0:1787784539.457215:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643126144 00000100:00100000:1.0:1787784539.457283:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787784539.457293:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643126144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787784539.457419:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784539.457655:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643126144:12345-0@lo:400:kworker.0 Request processed in 362us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784539.457663:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787784539.457731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643126016 00000100:00100000:0.0:1787784539.457735:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643126016 00000100:00100000:0.0:1787784539.457805:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784539.457813:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643126016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784539.457863:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643126016:12345-0@lo:400:kworker.0 Request processed in 51us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784539.457870:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787784539.457917:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643126144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784539.457991:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643126016:0@lo:400:kworker.0 00000100:00080000:2.0:1787784539.458073:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784539.703885:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784539.705419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724480 00000100:00100000:2.0:1787784539.705432:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724480 00000100:00100000:2.0:1787784539.705543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:2.0:1787784539.705554:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:11330:x1874627634724480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784539.705574:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784539.705593:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb2e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab57 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705671:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705686:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705711:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705727:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.705740:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb2f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706198:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706205:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb2f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784539.706215:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787784539.706441:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706448:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706453:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706458:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784539.706467:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706474:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706485:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943183923100) 00010000:00010000:2.0:1787784539.706487:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784539.706491:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706497:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb2e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706506:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706511:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706516:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706520:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784539.706523:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706527:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706533:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff943183923b00) 00010000:00010000:2.0:1787784539.706535:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784539.706541:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706547:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb2f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb2e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab57 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706926:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb2f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab57 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784539.706933:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:2.0:1787784539.706936:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784539.706938:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500600, rc 0) 00000100:00100000:2.0:1787784539.707016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:11330:x1874627634724480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1463us (3140us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787784539.707024:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00080000:0.0:1787784539.708407:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784539.724969:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784539.725044:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784539.725334:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724608 00000100:00100000:2.0:1787784539.725345:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724608 00000100:00100000:2.0:1787784539.725437:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:2.0:1787784539.725461:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:11330:x1874627634724608:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787784539.725577:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:11330:x1874627634724608:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 131us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784539.725585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1787784539.725740:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724736 00000100:00100000:3.0:1787784539.725745:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724736 00000100:00100000:3.0:1787784539.725790:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1787784539.725798:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:2365:x1874627634724736:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784539.725809:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784539.725835:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb2f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab57 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784539.725854:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:3.0:1787784539.725860:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784539.725882:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2365:x1874627634724736:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 86us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784539.725889:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00010000:00010000:0.0:1787784539.765848:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784539.959004:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784539.959030:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643126272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784539.959587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784539.960307:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643126272 00000100:00100000:3.0:1787784539.960316:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643126272 00000100:00100000:3.0:1787784539.960394:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787784539.960406:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643126272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784539.960472:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784539.960553:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643126272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784539.960561:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784539.960947:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643126272:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787784540.470707:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784540.470717:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784540.471258:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787784540.471267:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787784540.511097:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787784540.790820:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784540.939908:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784540.939972:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784540.940086:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724864 00000100:00100000:0.0:1787784540.940096:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724864 00000100:00100000:0.0:1787784540.940165:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 303 00000100:00100000:0.0:1787784540.940186:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634724864:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784540.940277:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634724864:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.940286:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 303 00000100:00100000:1.0:1787784540.941034:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634724992 00000100:00100000:1.0:1787784540.941041:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634724992 00000100:00100000:1.0:1787784540.941090:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:1.0:1787784540.941098:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2364:x1874627634724992:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784540.941246:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2364:x1874627634724992:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 148us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784540.941253:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:3.0:1787784540.946755:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784540.946995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784540.948234:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784540.948610:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725376 00000100:00100000:0.0:1787784540.948626:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725376 00000100:00100000:0.0:1787784540.948706:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:0.0:1787784540.948718:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2365:x1874627634725376:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784540.948802:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2365:x1874627634725376:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 87us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784540.948810:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00080000:0.0:1787784540.948835:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784540.949937:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725248 00000100:00100000:2.0:1787784540.949946:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725248 00000100:00100000:1.0:1787784540.950030:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725120 00000100:00100000:1.0:1787784540.950034:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725120 00000100:00100000:1.0:1787784540.950158:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:1.0:1787784540.950167:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634725120:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784540.950420:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2365:x1874627634725120:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 246us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784540.950428:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00080000:0.0:1787784540.953963:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787784540.953974:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784540.956737:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:1.0:1787784540.956754:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634725248:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784540.956842:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2365:x1874627634725248:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (10097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784540.956849:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00010000:00010000:2.0:1787784541.825152:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784541.952295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784541.952426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725504 00000100:00100000:0.0:1787784541.952515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725504 00000100:00100000:0.0:1787784541.952582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00100000:0.0:1787784541.952593:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:11372:x1874627634725504:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784541.952700:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784541.952722:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952790:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952805:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952816:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952833:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952840:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.952846:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953294:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953306:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953321:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953327:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784541.953331:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953338:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953349:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:0.0:1787784541.953352:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784541.953356:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953397:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb30c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953407:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953413:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953418:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953422:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784541.953425:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953438:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953517:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff943183fdcf00) 00010000:00010000:0.0:1787784541.953520:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784541.953523:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953530:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953565:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb305 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab5e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953575:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:0.0:1787784541.953578:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784541.953581:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab5e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.953590:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784541.953733:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:11372:x1874627634725504:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1142us (1447us total) trans 0 rc 301/301 00000100:00100000:0.0:1787784541.953741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00080000:0.0:1787784541.953765:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784541.967415:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784541.967843:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725760 00000100:00100000:0.0:1787784541.967854:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725760 00000100:00100000:0.0:1787784541.967938:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 140 00000100:00100000:0.0:1787784541.967949:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:11372:x1874627634725760:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:0.0:1787784541.968021:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784541.968050:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bac83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a997 expref: 13 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.968068:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:0.0:1787784541.968072:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784541.968351:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.968392:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 5 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.968403:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.968435:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 5 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784541.968568:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 5 pid: 8617 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784541.968584:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643126400:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784541.968692:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784542.005655:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.005688:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634725888 00000100:00100000:1.0:1787784542.005698:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634725888 00010000:00010000:1.0:1787784542.005754:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 6 pid: 8617 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.005797:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:1.0:1787784542.005808:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2362:x1874627634725888:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784542.005823:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784542.005830:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 6 pid: 8617 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.005843:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 6 pid: 8617 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.005867:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784542.005874:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.005892:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.005900:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.005920:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784542.005973:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2362:x1874627634725888:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 167us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784542.005981:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00080000:1.0:1787784542.006094:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784542.007195:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb2db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab50 expref: 5 pid: 8617 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.007232:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643126400:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784542.007255:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.007264:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.007270:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.007294:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.007304:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.007314:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784542.009088:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787784542.009105:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.009115:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.009122:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.010291:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784542.010307:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.010317:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.010334:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94318a498c00) 00010000:00010000:1.0:1787784542.010338:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784542.010343:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.010349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb31a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784542.010388:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7279815 reply state 00000000a679a386 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.010399:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784542.010564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:11372:x1874627634725760:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 42613us (43166us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787784542.010573:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 140 00010000:00010000:1.0:1787784542.026265:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026284:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026292:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026299:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784542.026304:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026327:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026344:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff943190486c00) 00010000:00010000:1.0:1787784542.026347:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784542.026353:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.026360:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb321 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.167034:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.167160:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726016 00000100:00100000:0.0:1787784542.167171:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726016 00000100:00100000:0.0:1787784542.167282:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 141 00000100:00100000:0.0:1787784542.167292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:11380:x1874627634726016:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:0.0:1787784542.167317:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.167397:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab65 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167490:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167506:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167518:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.167587:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787784542.167592:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784542.167617:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167637:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab65 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167650:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab65 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.167657:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:0.0:1787784542.167659:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784542.167662:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88e00, rc 0) 00000100:00100000:0.0:1787784542.167718:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:11380:x1874627634726016:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 428us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784542.167725:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 141 00000100:00100000:1.0:1787784542.251562:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.251678:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726144 00000100:00100000:0.0:1787784542.251701:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726144 00000100:00100000:0.0:1787784542.251768:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:0.0:1787784542.251779:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:11386:x1874627634726144:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784542.251800:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.251821:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab6c expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251898:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251913:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251936:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251952:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251960:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.251966:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252109:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252118:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252445:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.252681:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787784542.252685:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784542.252716:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252730:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252736:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252743:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252749:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784542.252755:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252763:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252777:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:0.0:1787784542.252779:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784542.252784:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252789:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb33d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252804:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252822:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252828:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252833:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784542.252836:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252842:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252850:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff943183fdc300) 00010000:00010000:0.0:1787784542.252853:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784542.252855:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.252860:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb344 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.255318:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab6c expref: 16 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.256813:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab6c expref: 15 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.256829:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784542.256832:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787784542.256854:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89a00, rc 0) 00000100:00100000:0.0:1787784542.257024:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:11386:x1874627634726144:12345-192.168.202.59@tcp:101:bash.0 Request processed in 5244us (5471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784542.257034:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:2.0:1787784542.273860:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.274799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726400 00000100:00100000:1.0:1787784542.274812:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726400 00000100:00100000:1.0:1787784542.274904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:1.0:1787784542.274918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+15:11386:x1874627634726400:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1787784542.274940:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784542.274962:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb352 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab73 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275159:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275177:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275188:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275277:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275285:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.275292:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784542.278262:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787784542.281119:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.281335:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282457:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282531:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282540:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282546:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282552:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784542.282557:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282583:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282598:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784542.282601:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784542.282605:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282611:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb359 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784542.282630:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004720dbc4 reply state 00000000cef4dcb8 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.282640:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787784542.282690:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb352 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282706:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.282712:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:1.0:1787784542.282715:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784542.282717:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784542.282947:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11386:x1874627634726400:12345-192.168.202.59@tcp:101:bash.0 Request processed in 8028us (9095us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787784542.282959:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 143 00010000:00010000:0.0:1787784542.285668:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285684:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285692:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285697:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784542.285701:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285708:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285725:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943190486c00) 00010000:00010000:0.0:1787784542.285728:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784542.285733:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.285739:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb360 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.287986:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784542.290801:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726528 00000100:00100000:3.0:1787784542.290818:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726528 00000100:00100000:3.0:1787784542.291011:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1787784542.291022:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634726528:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784542.291042:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784542.291064:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784542.291094:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784542.291127:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787784542.291132:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784542.291152:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.291171:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.291206:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611e00, rc 0) 00000100:00100000:3.0:1787784542.291290:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634726528:12345-192.168.202.59@tcp:101:bash.0 Request processed in 269us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784542.291297:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1787784542.295526:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.295664:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726656 00000100:00100000:2.0:1787784542.295677:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726656 00000100:00100000:2.0:1787784542.295740:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1787784542.295750:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:11386:x1874627634726656:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784542.295772:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784542.295792:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab81 expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.295826:0:8198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.295836:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784542.295841:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784542.295847:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.295899:0:8198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.295915:0:8198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.295943:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643126528:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784542.296043:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887ef600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784542.300568:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8198:1874627643126528:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784542.300618:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 7 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.300643:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500c00, rc 0) 00000100:00100000:2.0:1787784542.300714:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:11386:x1874627634726656:12345-192.168.202.59@tcp:101:bash.0 Request processed in 4965us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784542.300724:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1787784542.302583:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.303667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634726784 00000100:00100000:2.0:1787784542.303680:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634726784 00010000:00010000:2.0:1787784542.303725:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.303774:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:2.0:1787784542.303785:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634726784:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784542.303801:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784542.303824:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.303838:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.303892:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a17d2a5/0xffb8d925c20bb375 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab7a expref: 7 pid: 6678 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.303910:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784542.303915:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784542.303922:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.303934:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.303977:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.303991:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643126656:192.168.202.59@tcp:105: 00000100:00100000:2.0:1787784542.304081:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887ef600 going to sleep for 11 seconds 00000100:00080000:1.0:1787784542.306328:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784542.321560:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.321735:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874627643126656:192.168.202.59@tcp:105: 00010000:00010000:2.0:1787784542.321764:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784542.321843:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634726784:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 18058us (19266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784542.321855:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:0.0:1787784542.321974:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634727040 00000100:00100000:0.0:1787784542.321983:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634727040 00000100:00100000:0.0:1787784542.322048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:0.0:1787784542.322059:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:11386:x1874627634727040:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1787784542.322537:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11386:x1874627634727040:12345-192.168.202.59@tcp:35:bash.0 Request processed in 478us (987us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787784542.322545:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784542.493208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.493480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634727296 00000100:00100000:0.0:1787784542.493489:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634727296 00000100:00100000:0.0:1787784542.493553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00100000:0.0:1787784542.493562:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11396:x1874627634727296:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784542.493587:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.493619:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab88 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.493743:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787784542.493886:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb383 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab88 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.493901:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:0.0:1787784542.493904:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784542.493909:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab88 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.493925:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89600, rc 0) 00000100:00100000:0.0:1787784542.493995:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11396:x1874627634727296:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 433us (798us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787784542.494003:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00100000:1.0:1787784542.501256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.508570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634727552 00000100:00100000:0.0:1787784542.508585:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634727552 00000100:00100000:0.0:1787784542.508681:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:0.0:1787784542.508707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11396:x1874627634727552:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1787784542.508999:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11396:x1874627634727552:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 294us (7750us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787784542.509007:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784542.630473:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.630623:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634727680 00000100:00100000:0.0:1787784542.630634:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634727680 00000100:00100000:0.0:1787784542.630701:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 145 00000100:00100000:0.0:1787784542.630711:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11403:x1874627634727680:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784542.630734:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.630755:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab8f expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.630843:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.630856:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.630866:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.630944:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787784542.630948:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784542.630971:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.630999:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab8f expref: 22 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.631033:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab8f expref: 21 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.631042:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784542.631045:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784542.631048:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784542.631122:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11403:x1874627634727680:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 413us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784542.631135:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 145 00000100:00100000:3.0:1787784542.637458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.637666:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634727936 00000100:00100000:1.0:1787784542.637676:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634727936 00000100:00100000:1.0:1787784542.637727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 146 00000100:00100000:1.0:1787784542.637738:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11403:x1874627634727936:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784542.637758:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784542.637777:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb39f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab96 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.637899:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb3a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.637914:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.637926:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb3a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784542.637938:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787784542.638078:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb39f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab96 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.638096:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb3a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab96 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.638116:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:1.0:1787784542.638119:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784542.638123:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784542.638305:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:11403:x1874627634727936:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 568us (857us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787784542.638327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 146 00000100:00100000:2.0:1787784542.642798:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.642845:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.642925:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728320 00000100:00100000:1.0:1787784542.642935:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728320 00000100:00100000:1.0:1787784542.643002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1787784542.643012:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:2363:x1874627634728320:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784542.643028:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784542.643055:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb3a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab96 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.643074:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:1.0:1787784542.643079:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784542.643154:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2363:x1874627634728320:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 143us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784542.643162:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1787784542.644096:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728192 00000100:00100000:3.0:1787784542.644115:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728192 00000100:00100000:3.0:1787784542.644173:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:3.0:1787784542.644181:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11403:x1874627634728192:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784542.644204:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784542.644235:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb3b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ab9d expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.644332:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.644345:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.644355:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784542.644392:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787784542.644551:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb3b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab9d expref: 25 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.644569:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab9d expref: 24 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.644576:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:3.0:1787784542.644579:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787784542.644582:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611000, rc 0) 00000100:00100000:3.0:1787784542.644640:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11403:x1874627634728192:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 460us (1853us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787784542.644648:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:2.0:1787784542.672814:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784542.672935:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728448 00000100:00100000:3.0:1787784542.672946:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728448 00000100:00100000:3.0:1787784542.673010:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1787784542.673020:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634728448:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:3.0:1787784542.673065:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.673085:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.673095:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784542.673100:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784542.673105:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.673140:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.673164:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 6 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784542.673180:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874627643126784:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784542.673279:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784542.676085:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874627643126784:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784542.676117:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.677135:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.677736:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728576 00000100:00100000:0.0:1787784542.677746:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728576 00002000:00100000:0.0:1787784542.677804:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff943187f9e1c0 x1874627634728576/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:423/0 lens 504/0 e 0 to 0 dl 1787784553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784542.677816:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943187f9e1c0 with x1874627634728576 ext(0->12) 00010000:00010000:0.0:1787784542.677826:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 7 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.677855:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 7 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784542.677864:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff943187f9e1c0 00000100:00100000:0.0:1787784542.677908:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:0.0:1787784542.677923:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634728576:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:0.0:1787784542.681754:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634728576:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 3826us (4613us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787784542.681779:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00002000:00100000:0.0:1787784542.681792:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff943187f9e1c0 x1874627634728576/t4294967305(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:423/0 lens 504/448 e 0 to 0 dl 1787784553 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784542.681802:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943187f9e1c0 with x1874627634728576 ext(0->12) 00010000:00010000:0.0:1787784542.681812:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.681831:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784542.681839:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff943187f9e1c0 00000100:00100000:1.0:1787784542.692944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.693174:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728704 00000100:00100000:0.0:1787784542.693188:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728704 00010000:00010000:0.0:1787784542.693246:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784542.693296:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1787784542.693307:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2365:x1874627634728704:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784542.693324:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787784542.693345:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787784542.693349:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787784542 00002000:00010000:0.0:1787784542.693351:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787784542 00002000:00010000:0.0:1787784542.693353:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787784542 00010000:00010000:0.0:1787784542.693360:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.693927:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.693955:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4b97b4/0xffb8d925c20bb37c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ab81 expref: 9 pid: 8198 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.693975:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784542.693980:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784542.693986:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.693997:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.695411:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784542.695519:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2365:x1874627634728704:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 2207us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784542.695531:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00010000:00010000:3.0:1787784542.703614:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703635:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703679:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703687:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703696:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703723:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784542.703728:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703737:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703758:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.703765:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efe27f9c/0xffb8d925c20bb3c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784542.703916:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634728448:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 30892us (31109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784542.703928:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:1.0:1787784542.713032:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.713124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634728960 00000100:00100000:0.0:1787784542.713148:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634728960 00000100:00100000:0.0:1787784542.713223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1787784542.713235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11403:x1874627634728960:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:0.0:1787784542.713309:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab9d expref: 24 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784542.713679:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787784542.713729:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787784542.714361:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787784542.714455:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.714471:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.714480:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.714515:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.714529:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 28 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784542.714543:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643126912:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784542.714649:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787784542.719545:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784542.719635:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634729088 00000100:00100000:3.0:1787784542.719645:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634729088 00010000:00010000:3.0:1787784542.719685:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 29 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784542.719726:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1787784542.719735:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:2363:x1874627634729088:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784542.719752:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784542.719759:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 29 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.719784:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 29 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.719807:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:3.0:1787784542.719813:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.719823:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.719830:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784542.719850:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784542.719923:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:2363:x1874627634729088:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 189us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784542.719932:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00010000:00010000:0.0:1787784542.723040:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ab73 expref: 28 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784542.723069:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba340b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874627643126912:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784542.723096:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.723141:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.723147:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784542.723304:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787784542.723889:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787784542.724018:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431884f5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643127040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787784542.724087:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784542.724192:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787784542.724285:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643127040 00000100:00100000:3.0:1787784542.724293:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643127040 00000100:00100000:3.0:1787784542.724395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784542.724405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643127040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787784542.724510:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643127040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784542.724517:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784542.724628:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431884f5e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643127040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784542.725124:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787784542.725199:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643127168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787784542.725234:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784542.725262:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784542.726561:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643127168 00000100:00100000:3.0:1787784542.726575:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643127168 00000100:00100000:3.0:1787784542.726618:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787784542.726626:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874627643127168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787784542.726889:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874627643127168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 262us (1653us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787784542.726897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787784542.727264:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784542.729348:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197116d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874627643127168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787784542.729519:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787784542.729589:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729600:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729607:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729613:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784542.729618:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729625:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729643:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:2.0:1787784542.729646:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787784542.729650:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.729657:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784542.729913:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787784542.730021:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787784542.730034:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357556668490ns, next at 358556666306ns, rc = 0 00000001:00080000:2.0:1787784542.730041:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787784542.730075:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486400) 00010000:00010000:2.0:1787784542.730079:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787784542.730087:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb3bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab9d expref: 32 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.730224:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:11403:x1874627634728960:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 16990us (17203us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787784542.730235:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000020:00080000:2.0:1787784542.730240:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787784542.741691:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.741784:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634729216 00000100:00100000:0.0:1787784542.741794:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634729216 00000100:00100000:0.0:1787784542.741859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:0.0:1787784542.741880:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:11403:x1874627634729216:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784542.741908:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.741935:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb3d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aba4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.742010:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aba4 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.742026:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aba4 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.742047:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:0.0:1787784542.742050:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784542.742054:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89800, rc 0) 00000100:00100000:0.0:1787784542.742125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11403:x1874627634729216:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 256us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784542.742132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:3.0:1787784542.747199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.747290:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634729472 00000100:00100000:2.0:1787784542.747300:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634729472 00000100:00100000:2.0:1787784542.747357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1787784542.747403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11403:x1874627634729472:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784542.747669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:11403:x1874627634729472:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 269us (478us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787784542.747678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00010000:00010000:2.0:1787784542.836841:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784542.875251:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.876027:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634729728 00000100:00100000:0.0:1787784542.876041:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634729728 00000100:00100000:0.0:1787784542.876230:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00100000:0.0:1787784542.876242:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:11413:x1874627634729728:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784542.876268:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.876298:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.876485:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787784542.876805:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abab expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.876821:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:0.0:1787784542.876824:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784542.876830:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb3de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abab expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.876845:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89600, rc 0) 00000100:00100000:0.0:1787784542.877005:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11413:x1874627634729728:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 764us (1764us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787784542.877013:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00100000:1.0:1787784542.883227:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784542.883659:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634729856 00000100:00100000:2.0:1787784542.883671:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634729856 00000100:00100000:2.0:1787784542.883735:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 150 00000100:00100000:2.0:1787784542.883746:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11413:x1874627634729856:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1787784542.883844:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.883861:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.883889:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.883906:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.883913:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885011:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885692:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885706:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885717:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784542.885766:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885779:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885803:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885810:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885816:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784542.885820:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885828:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885838:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784542.885840:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784542.885844:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885850:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb3ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885860:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885865:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885885:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885890:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784542.885899:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885905:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.885912:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923b00) 00010000:00010000:2.0:1787784542.885914:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784542.885918:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887047:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb3f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887080:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887086:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887093:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887098:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784542.887213:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887222:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887235:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784542.887238:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784542.887254:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784542.887260:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb3fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784542.887850:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11413:x1874627634729856:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 4101us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784542.887864:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 150 00000100:00100000:2.0:1787784542.895329:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.895540:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634730112 00000100:00100000:1.0:1787784542.895551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634730112 00000100:00100000:1.0:1787784542.895626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:1.0:1787784542.895636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11413:x1874627634730112:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784542.895937:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:11413:x1874627634730112:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 302us (618us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787784542.895946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:1.0:1787784542.960309:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784542.960587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634730368 00000100:00100000:0.0:1787784542.960597:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634730368 00000100:00100000:0.0:1787784542.960724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 151 00000100:00100000:0.0:1787784542.960735:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:11416:x1874627634730368:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784542.960758:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784542.960780:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb401 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abb2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960885:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960915:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.960946:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961070:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961078:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961085:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784542.961095:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787784542.961428:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961436:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961448:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961454:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784542.961458:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961466:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961478:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784542.961481:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784542.961486:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961492:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961508:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961514:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961519:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961524:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784542.961526:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961540:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961547:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183fdc800) 00010000:00010000:0.0:1787784542.961549:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784542.961551:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb40f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961602:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb401 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961615:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784542.961622:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:0.0:1787784542.961624:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784542.961626:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784542.961959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11416:x1874627634730368:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1224us (1659us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787784542.961967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 151 00000100:00100000:0.0:1787784542.968316:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.977148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634730496 00000100:00100000:1.0:1787784542.977168:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634730496 00000100:00100000:1.0:1787784542.977246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00100000:1.0:1787784542.977258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11416:x1874627634730496:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:1.0:1787784542.977331:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977350:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977378:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977407:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977421:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977429:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977435:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784542.977439:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977460:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977473:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:1.0:1787784542.977476:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784542.977481:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784542.977487:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784542.977586:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11416:x1874627634730496:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 330us (9284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784542.977594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00100000:2.0:1787784542.983510:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784542.983714:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634730752 00000100:00100000:1.0:1787784542.983726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634730752 00000100:00100000:1.0:1787784542.983795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:1.0:1787784542.983808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11416:x1874627634730752:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784542.984109:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:11416:x1874627634730752:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 302us (610us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787784542.984119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1787784543.030270:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784543.030300:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643127296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784543.030427:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784543.030771:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643127296 00000100:00100000:2.0:1787784543.030779:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643127296 00000100:00100000:2.0:1787784543.030850:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787784543.030860:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643127296:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784543.030904:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787784543.030907:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784543.030967:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643127296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784543.030975:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787784543.031013:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643127296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784543.316296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784543.316457:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634731008 00000100:00100000:2.0:1787784543.316468:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634731008 00000100:00100000:2.0:1787784543.316545:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 153 00000100:00100000:2.0:1787784543.316556:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:11447:x1874627634731008:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1787784543.316582:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784543.316615:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb42b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abb9 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.316721:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.316754:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.316769:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784543.316782:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787784543.316927:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb42b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb9 expref: 41 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.316948:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb9 expref: 40 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.316958:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784543.316961:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784543.316965:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784543.317041:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11447:x1874627634731008:12345-192.168.202.59@tcp:101:cat.0 Request processed in 487us (755us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787784543.317050:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 153 00000100:00080000:1.0:1787784543.317606:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784543.321769:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784543.321848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634731264 00000100:00100000:3.0:1787784543.321858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634731264 00000100:00100000:3.0:1787784543.321931:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:3.0:1787784543.321942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11447:x1874627634731264:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:3.0:1787784543.322273:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:11447:x1874627634731264:12345-192.168.202.59@tcp:35:cat.0 Request processed in 333us (513us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787784543.322281:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:0.0:1787784543.330097:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784543.333409:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634731392 00000100:00100000:2.0:1787784543.333425:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634731392 00000100:00100000:2.0:1787784543.333515:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784543.333526:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:2362:x1874627634731392:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784543.333543:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784543.333569:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb9 expref: 41 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.333607:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784543.333612:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784543.333787:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:2362:x1874627634731392:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 262us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784543.333795:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784543.384850:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784543.385007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634731648 00000100:00100000:1.0:1787784543.385017:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634731648 00000100:00100000:1.0:1787784543.385112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 154 00000100:00100000:1.0:1787784543.385123:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11453:x1874627634731648:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:1.0:1787784543.385163:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784543.385166:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787784543.385195:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab8f expref: 40 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385225:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784543.385231:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784543.385245:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb440 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abc0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385361:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385437:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385446:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385478:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.385492:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 40 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784543.385506:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431884f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643127424:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784543.385598:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431887d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784543.388817:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431884f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643127424:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784543.388849:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784543.389093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784543.389164:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634731776 00000100:00100000:3.0:1787784543.389170:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634731776 00010000:00010000:3.0:1787784543.389206:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 41 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784543.389245:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:3.0:1787784543.389255:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+41:2363:x1874627634731776:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784543.389279:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784543.389286:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 41 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389297:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 41 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389329:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abb2 expref: 41 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389341:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784543.389344:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389350:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389355:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.389395:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784543.389443:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:2363:x1874627634731776:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 191us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784543.389448:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00010000:00010000:2.0:1787784543.389575:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.389581:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784543.389596:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787784543.389742:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb440 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.389756:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.389763:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784543.389766:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784543.389768:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:2.0:1787784543.389793:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11453:x1874627634731648:12345-192.168.202.59@tcp:101:dd.0 Request processed in 4673us (4954us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787784543.389807:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 154 00000100:00100000:1.0:1787784543.394185:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784543.394289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732032 00000100:00100000:2.0:1787784543.394300:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732032 00000100:00100000:2.0:1787784543.394407:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 155 00000100:00100000:2.0:1787784543.394428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11453:x1874627634732032:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:2.0:1787784543.394710:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.394728:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.394740:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784543.394796:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787784543.394822:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0cefaea reply state 000000005b656787 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784543.394833:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784543.394933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11453:x1874627634732032:12345-192.168.202.59@tcp:36:dd.0 Request processed in 508us (758us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787784543.394942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 155 00000020:00080000:2.0:1787784543.394947:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787784543.396746:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396761:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396768:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396773:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784543.396776:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396783:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396798:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:1.0:1787784543.396801:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784543.396806:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.396811:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb455 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784543.668230:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784543.668354:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732160 00000100:00100000:3.0:1787784543.668386:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732160 00000100:00100000:3.0:1787784543.668460:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:3.0:1787784543.668471:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+42:11467:x1874627634732160:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:3.0:1787784543.668509:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784543.668544:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb45c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abc7 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668616:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668648:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668658:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668674:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668681:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668688:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668793:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668804:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668812:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668843:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784543.668857:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 43 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784543.668896:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf40c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643127552:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784543.669000:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784543.674560:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784543.674684:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf40c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643127552:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784543.674711:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784543.678704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732416 00000100:00100000:1.0:1787784543.678722:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732416 00000100:00100000:1.0:1787784543.678817:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1787784543.678829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+44:5607:x1874627634732416:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787784543.679231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:5607:x1874627634732416:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 402us (4680us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787784543.679257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1787784543.682343:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784543.682893:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732544 00000100:00100000:0.0:1787784543.682904:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732544 00010000:00010000:0.0:1787784543.682947:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 45 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784543.683041:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:0.0:1787784543.683053:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:2363:x1874627634732544:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784543.683069:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784543.683077:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 45 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.683090:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 45 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.683113:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb447 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abc0 expref: 45 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.683129:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:0.0:1787784543.683135:0:8443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.683144:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.683167:0:8443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.686401:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784543.686495:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+44:2363:x1874627634732544:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 3437us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784543.686510:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00010000:00010000:1.0:1787784543.686615:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686627:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784543.686684:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787784543.686688:0:8617:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784543.686710:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686726:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686737:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686744:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686752:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686758:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784543.686762:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686769:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686803:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784543.686806:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784543.686810:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686818:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb463 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686834:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686841:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686847:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686853:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784543.686855:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686873:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686882:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94319746e600) 00010000:00010000:1.0:1787784543.686885:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784543.686888:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686894:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb46a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686947:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb45c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc7 expref: 44 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686961:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc7 expref: 43 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784543.686969:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:1.0:1787784543.686971:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784543.686974:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610c00, rc 0) 00000100:00100000:1.0:1787784543.687002:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11467:x1874627634732160:12345-192.168.202.59@tcp:101:stat.0 Request processed in 18534us (18784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784543.687009:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:0.0:1787784543.813496:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784543.813745:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732800 00000100:00100000:2.0:1787784543.813755:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732800 00000100:00100000:2.0:1787784543.813818:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 157 00000100:00100000:2.0:1787784543.813828:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11473:x1874627634732800:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:2.0:1787784543.813898:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784543.813938:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abc7 expref: 43 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.813958:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784543.813964:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784543.818560:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.818587:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.818600:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784543.818736:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787784543.818791:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f475e55 reply state 0000000025bfef2f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784543.818801:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784543.819027:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:11473:x1874627634732800:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 5194us (5535us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787784543.819036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 157 00000020:00080000:2.0:1787784543.819042:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784543.828138:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828160:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828169:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828175:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784543.828181:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828189:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828211:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:0.0:1787784543.828214:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784543.828219:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784543.828226:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb478 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784543.860703:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784544.060657:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.060892:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634732928 00000100:00100000:2.0:1787784544.060902:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634732928 00000100:00100000:2.0:1787784544.060975:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00100000:2.0:1787784544.060989:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+44:11487:x1874627634732928:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:2.0:1787784544.061024:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.061053:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb47f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abce expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061147:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061161:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061172:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061187:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061199:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061205:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061349:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061361:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061411:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.061454:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787784544.061458:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784544.061483:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061699:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061711:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061721:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061730:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061738:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784544.061745:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061756:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061771:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784544.061777:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784544.061868:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061879:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061903:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.061912:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062013:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062021:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784544.062024:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062037:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062048:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923b00) 00010000:00010000:2.0:1787784544.062050:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784544.062056:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062062:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb48d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062152:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb47f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 46 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062166:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 45 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.062174:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784544.062176:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784544.062179:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501c00, rc 0) 00000100:00100000:2.0:1787784544.062941:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:11487:x1874627634732928:12345-192.168.202.59@tcp:101:stat.0 Request processed in 1943us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784544.062965:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00100000:1.0:1787784544.170086:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.170185:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634733184 00000100:00100000:3.0:1787784544.170195:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634733184 00000100:00100000:3.0:1787784544.170260:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 159 00000100:00100000:3.0:1787784544.170271:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+45:11497:x1874627634733184:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784544.170294:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784544.170316:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb49b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abd5 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784544.170479:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787784544.170626:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb49b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abd5 expref: 47 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.170641:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:3.0:1787784544.170644:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784544.170649:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb49b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abd5 expref: 47 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.170663:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610000, rc 0) 00000100:00100000:3.0:1787784544.170730:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+46:11497:x1874627634733184:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 461us (654us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787784544.170754:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 159 00000100:00100000:1.0:1787784544.174570:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.174744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634733440 00000100:00100000:3.0:1787784544.174757:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634733440 00000100:00100000:3.0:1787784544.174818:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1787784544.174829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+46:11497:x1874627634733440:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784544.175131:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:11497:x1874627634733440:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 302us (572us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787784544.175139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1787784544.287490:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.287696:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634733696 00000100:00100000:2.0:1787784544.287707:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634733696 00000100:00100000:2.0:1787784544.287775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00100000:2.0:1787784544.287786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:11503:x1874627634733696:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784544.287811:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.287833:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abdc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.287957:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.287972:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 48 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.287982:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.288021:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 48 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.288034:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 48 pid: 8618 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784544.288048:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643127680:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784544.288158:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784544.291183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.291270:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634733824 00000100:00100000:3.0:1787784544.291280:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634733824 00010000:00010000:3.0:1787784544.291322:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 49 pid: 8618 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784544.291404:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:3.0:1787784544.291414:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:2363:x1874627634733824:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784544.291430:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784544.291438:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 49 pid: 8618 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.291456:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 49 pid: 8618 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.291484:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784544.291490:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.291854:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.291873:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.291896:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784544.291969:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+49:2363:x1874627634733824:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 555us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.291978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00010000:00010000:2.0:1787784544.293472:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abce expref: 48 pid: 8618 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784544.293681:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643127680:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784544.293712:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.293724:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.293729:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.293750:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787784544.293937:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.293952:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.293960:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784544.293963:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784544.293966:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:2.0:1787784544.294106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+48:11503:x1874627634733696:12345-192.168.202.59@tcp:101:bash.0 Request processed in 6322us (6626us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787784544.294127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00100000:1.0:1787784544.298434:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.298601:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734080 00000100:00100000:2.0:1787784544.298613:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734080 00000100:00100000:2.0:1787784544.298673:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 161 00000100:00100000:2.0:1787784544.298683:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+48:11503:x1874627634734080:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1787784544.299020:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.299038:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.299049:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784544.299105:0:8618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787784544.299134:0:8618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009db34476 reply state 00000000a2c15150 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784544.299143:0:8618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784544.299241:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11503:x1874627634734080:12345-192.168.202.59@tcp:36:bash.0 Request processed in 557us (817us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787784544.299249:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 161 00000020:00080000:2.0:1787784544.299254:0:8618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787784544.310554:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.311547:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734208 00000100:00100000:2.0:1787784544.311559:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734208 00000100:00100000:2.0:1787784544.311637:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:2.0:1787784544.311648:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11503:x1874627634734208:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784544.311680:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.311706:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abe3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311795:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311811:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311834:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311841:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311869:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311900:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.311914:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784544.311928:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643127808:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784544.312017:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddd600 going to sleep for 11 seconds 00010000:00010000:1.0:1787784544.312263:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312272:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312279:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312285:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784544.312289:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312308:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312323:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:1.0:1787784544.312325:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784544.312329:0:3280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312338:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784544.312345:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb4be lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784544.318700:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.319163:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734336 00000100:00100000:3.0:1787784544.319174:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734336 00010000:00010000:3.0:1787784544.319224:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784544.319257:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:3.0:1787784544.319267:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:2362:x1874627634734336:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784544.319283:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784544.319291:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.319304:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 52 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.319329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784544.319334:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.319359:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.319416:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.319442:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784544.319504:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:2362:x1874627634734336:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 239us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.319512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00010000:00010000:2.0:1787784544.321092:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849abdc expref: 51 pid: 5833 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784544.321130:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874627643127808:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784544.321161:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.321173:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.321178:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.321245:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787784544.321250:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784544.321270:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.321306:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abe3 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.321321:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abe3 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.321330:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784544.321333:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784544.321336:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501c00, rc 0) 00000100:00100000:2.0:1787784544.322234:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:11503:x1874627634734208:12345-192.168.202.59@tcp:101:bash.0 Request processed in 10581us (11685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784544.322245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:1.0:1787784544.331641:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.331741:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734592 00000100:00100000:3.0:1787784544.331753:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734592 00000100:00100000:3.0:1787784544.331815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1787784544.331825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:11503:x1874627634734592:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:3.0:1787784544.332132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11503:x1874627634734592:12345-192.168.202.59@tcp:35:bash.0 Request processed in 308us (506us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787784544.332140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:1.0:1787784544.474456:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.474565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734848 00000100:00100000:2.0:1787784544.474576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734848 00000100:00100000:2.0:1787784544.474644:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00100000:2.0:1787784544.474654:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11513:x1874627634734848:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784544.474679:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.474702:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.474831:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787784544.474980:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abea expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.475010:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:2.0:1787784544.475014:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784544.475021:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abea expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.475036:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501200, rc 0) 00000100:00100000:2.0:1787784544.475106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11513:x1874627634734848:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 454us (662us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787784544.475114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00100000:1.0:1787784544.479647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.479836:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634734976 00000100:00100000:3.0:1787784544.479847:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634734976 00000100:00100000:3.0:1787784544.479921:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 164 00000100:00100000:3.0:1787784544.479933:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11513:x1874627634734976:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1787784544.480019:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480036:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480046:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480076:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480084:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480090:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480203:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480213:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480220:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784544.480269:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480283:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480288:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480296:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480303:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784544.480308:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480323:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480336:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:3.0:1787784544.480340:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784544.480345:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480352:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb4e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480406:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480413:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480420:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480426:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784544.480429:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480436:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480443:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94319746e200) 00010000:00010000:3.0:1787784544.480446:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784544.480450:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480466:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb4e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480481:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480486:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480492:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480496:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784544.480499:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480505:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480513:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784544.480515:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784544.480518:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.480524:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb4ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784544.480605:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11513:x1874627634734976:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 673us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.480613:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 164 00000100:00100000:1.0:1787784544.483362:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.483641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634735232 00000100:00100000:3.0:1787784544.483652:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634735232 00000100:00100000:3.0:1787784544.483709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1787784544.483719:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11513:x1874627634735232:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784544.484179:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+53:11513:x1874627634735232:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 458us (825us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787784544.484187:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:1.0:1787784544.564725:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643128064:0@lo:400:kworker.0 00000100:00100000:1.0:1787784544.564800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784544.565490:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784544.565507:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643127936:0@lo:400:kworker.0 00000100:00100000:2.0:1787784544.565553:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784544.565602:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128064 00000100:00100000:2.0:1787784544.565609:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128064 00000100:00100000:2.0:1787784544.565657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787784544.565665:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643128064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.565762:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643128192:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.565794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784544.565829:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128192 00000100:00100000:3.0:1787784544.565833:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128192 00000100:00100000:3.0:1787784544.565879:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787784544.565885:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643128192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.565921:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643128192:12345-0@lo:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.565928:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787784544.565966:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643128192:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.566027:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643127936 00000100:00100000:3.0:1787784544.566030:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643127936 00000100:00100000:3.0:1787784544.566057:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787784544.566063:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643127936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.566099:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431856a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643127936:12345-0@lo:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.566105:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787784544.566147:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643127936:0@lo:400:kworker.0 00000100:00080000:3.0:1787784544.566201:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784544.574896:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643128448:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.574973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784544.575026:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784544.575033:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643128320:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.575059:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784544.575225:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128320 00000100:00100000:3.0:1787784544.575233:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128320 00000100:00100000:3.0:1787784544.575287:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787784544.575297:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643128320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.575352:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643128320:12345-0@lo:400:kworker.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.575358:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787784544.575407:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784544.575417:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643128576:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.575446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784544.575477:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128576 00000100:00100000:3.0:1787784544.575481:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128576 00000100:00100000:3.0:1787784544.575513:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787784544.575531:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643128576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.575564:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643128576:12345-0@lo:400:kworker.0 Request processed in 46us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.575570:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787784544.575587:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784544.575633:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643128576:0@lo:400:kworker.0 00000100:00100000:3.0:1787784544.575667:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf698f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643128320:0@lo:400:kworker.0 00000100:00100000:0.0:1787784544.576107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128448 00000100:00100000:0.0:1787784544.576113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128448 00000100:00100000:0.0:1787784544.576162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787784544.576170:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643128448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784544.576218:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643128448:12345-0@lo:400:kworker.0 Request processed in 50us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784544.576224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787784544.576290:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.577042:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643128064:12345-0@lo:400:kworker.0 Request processed in 11373us (12238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784544.577052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787784544.577076:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634735488 00000100:00100000:2.0:1787784544.577081:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634735488 00000100:00100000:2.0:1787784544.577116:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:2.0:1787784544.577124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+53:11516:x1874627634735488:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784544.577148:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.577170:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abf1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577284:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577302:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577342:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577349:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577357:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577545:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb50b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577556:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb50b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577564:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb50b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.577578:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787784544.577685:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577694:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784544.577705:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643128064:0@lo:400:kworker.0 00010000:00010000:2.0:1787784544.577718:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577727:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784544.577731:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577740:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577755:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784544.577759:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784544.577765:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577773:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb4fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577786:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577793:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577799:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577804:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784544.577807:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577825:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577834:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923b00) 00010000:00010000:2.0:1787784544.577837:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784544.577840:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577847:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577906:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb4f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.577919:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb50b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf1 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787784544.578261:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784544.578297:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643128448:0@lo:400:kworker.0 00010000:00010000:2.0:1787784544.578303:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784544.578307:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784544.578310:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500a00, rc 0) 00000100:00100000:2.0:1787784544.578780:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11516:x1874627634735488:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1654us (2489us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787784544.578789:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:1.0:1787784544.583710:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784544.583814:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634735744 00000100:00100000:0.0:1787784544.583825:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634735744 00000100:00100000:0.0:1787784544.583895:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:0.0:1787784544.583906:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11516:x1874627634735744:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784544.583983:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584002:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584014:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584045:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584053:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584077:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584084:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784544.584088:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584096:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584110:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:0.0:1787784544.584113:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784544.584118:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.584124:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784544.584206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11516:x1874627634735744:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 302us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784544.584215:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:1.0:1787784544.584446:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.589300:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634735616 00000100:00100000:2.0:1787784544.589316:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634735616 00000100:00100000:3.0:1787784544.589886:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1787784544.589897:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:2364:x1874627634735616:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784544.589917:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784544.589944:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb50b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf1 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.589965:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784544.589970:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784544.590043:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:2364:x1874627634735616:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 148us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.590051:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1787784544.597313:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.597438:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634736000 00000100:00100000:2.0:1787784544.597448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634736000 00000100:00100000:2.0:1787784544.597511:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1787784544.597531:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:11516:x1874627634736000:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784544.604008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11516:x1874627634736000:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 6474us (6690us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787784544.604024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:0.0:1787784544.741356:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.741497:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634736256 00000100:00100000:3.0:1787784544.741507:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634736256 00000100:00100000:3.0:1787784544.741563:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:3.0:1787784544.741572:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11534:x1874627634736256:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1787784544.741598:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784544.741620:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abf8 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.741737:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb527 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.741759:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb527 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.741771:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb527 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784544.741784:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787784544.741945:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf8 expref: 58 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.741963:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb527 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf8 expref: 57 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.741972:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:3.0:1787784544.741975:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787784544.741978:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610c00, rc 0) 00000100:00100000:3.0:1787784544.742029:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11534:x1874627634736256:12345-192.168.202.59@tcp:101:cat.0 Request processed in 458us (685us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787784544.742036:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:1.0:1787784544.767150:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.767817:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634736384 00000100:00100000:2.0:1787784544.767828:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634736384 00000100:00100000:2.0:1787784544.767902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:2.0:1787784544.767913:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11535:x1874627634736384:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784544.767939:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784544.767958:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849abff expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768016:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768026:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768035:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784544.768087:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787784544.768090:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784544.768106:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768233:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abff expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768247:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abff expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.768306:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784544.768321:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784544.768324:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501000, rc 0) 00000100:00100000:2.0:1787784544.768480:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11535:x1874627634736384:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 566us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784544.768488:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:0.0:1787784544.779598:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.779756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634736768 00000100:00100000:3.0:1787784544.779767:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634736768 00000100:00100000:3.0:1787784544.779829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1787784544.779838:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11535:x1874627634736768:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784544.780201:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11535:x1874627634736768:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 363us (611us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787784544.780210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1787784544.782501:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784544.783787:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634736896 00000100:00100000:2.0:1787784544.783806:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634736896 00000100:00100000:2.0:1787784544.783886:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784544.783901:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11535:x1874627634736896:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:2.0:1787784544.783922:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787784544.783946:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb4cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abe3 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.783968:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610c00/0xffb8d925c20bb527 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abf8 expref: 58 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.783981:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb3d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aba4 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784544.783993:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183fdc300) 00010000:00010000:2.0:1787784544.784002:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784544.784070:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11535:x1874627634736896:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 172us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784544.784077:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1787784544.799486:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784544.799588:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737024 00000100:00100000:3.0:1787784544.799599:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737024 00000100:00100000:3.0:1787784544.799661:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:3.0:1787784544.799671:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11535:x1874627634737024:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:3.0:1787784544.799804:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.799822:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784544.799964:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784544.800175:0:8617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787784544.800329:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11535:x1874627634737024:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 659us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784544.800338:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:3.0:1787784544.844025:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784544.847592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737152 00000100:00100000:0.0:1787784544.847608:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737152 00000100:00100000:0.0:1787784544.847699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:0.0:1787784544.847711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11537:x1874627634737152:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784544.847756:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784544.847777:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb54a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac06 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847878:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847894:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847905:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847920:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847928:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.847935:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848033:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848042:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848049:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784544.848084:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787784544.848093:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784544.848114:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848127:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848134:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848140:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848146:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848152:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784544.848156:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848163:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848185:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784544.848189:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784544.848195:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848201:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848215:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.848230:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849044:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849050:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784544.849054:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849061:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849072:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183fdc800) 00010000:00010000:0.0:1787784544.849075:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784544.849079:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849131:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb54a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849145:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784544.849151:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:0.0:1787784544.849165:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784544.849184:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784544.849271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11537:x1874627634737152:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1562us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784544.849280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 170 00010000:00010000:2.0:1787784544.885944:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784545.076690:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643128704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784545.076773:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787784545.076907:0:7915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359903540209ns, next at 360903537687ns, rc = 0 00000100:00100000:2.0:1787784545.076961:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128704 00000100:00100000:2.0:1787784545.076989:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128704 00000100:00100000:2.0:1787784545.077044:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787784545.077055:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643128704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784545.077096:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784545.081008:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba340780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643128704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3946us (4224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.081022:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787784545.086280:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643128704:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787784545.593030:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784545.593041:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784545.593261:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787784545.593269:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784545.594564:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643128832:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784545.595323:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431961aa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787784545.623251:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784545.626311:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431891612c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643128832:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784545.626558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737280 00000100:00100000:2.0:1787784545.626565:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737280 00000100:00100000:2.0:1787784545.626636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:2.0:1787784545.626646:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431904470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11548:x1874627634737280:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784545.626880:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784545.626996:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431904470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11548:x1874627634737280:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 350us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.627004:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00080000:2.0:1787784545.627025:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784545.652298:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.654880:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737408 00000100:00100000:0.0:1787784545.654896:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737408 00000100:00100000:0.0:1787784545.654963:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 172 00000100:00100000:0.0:1787784545.654973:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11548:x1874627634737408:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787784545.655045:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655062:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655075:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655091:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655098:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655234:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655267:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655276:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655293:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784545.655357:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787784545.655361:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784545.655872:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655887:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655893:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655901:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655907:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784545.655911:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655917:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655930:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:0.0:1787784545.655933:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784545.655938:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655945:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb566 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655967:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655974:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655981:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655986:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784545.655990:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.655996:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656004:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff943183fdcd00) 00010000:00010000:0.0:1787784545.656007:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784545.656010:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656016:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb56d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656031:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656038:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656044:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656056:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784545.656059:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656066:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656074:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:0.0:1787784545.656077:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784545.656080:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.656086:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784545.657277:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11548:x1874627634737408:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 2297us (4979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.657289:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 172 00000100:00100000:3.0:1787784545.674482:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.674522:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737664 00000100:00100000:3.0:1787784545.674532:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737664 00000100:00100000:3.0:1787784545.674586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 173 00000100:00100000:3.0:1787784545.674597:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11548:x1874627634737664:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784545.674619:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784545.674651:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb57b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac0d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.677033:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.677051:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.677064:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784545.677077:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787784545.678390:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678415:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678423:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678430:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784545.678435:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678443:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678458:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:3.0:1787784545.678461:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784545.678466:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678538:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb57b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac0d expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678549:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:3.0:1787784545.678552:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784545.678556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb57b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac0d expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.678566:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610000, rc 0) 00000100:00100000:3.0:1787784545.678643:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634737664:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4047us (4173us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787784545.678653:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 173 00000040:00080000:2.0:1787784545.683026:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784545.683035:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784545.683074:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787784545.683086:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787784545.690314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.690354:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634737792 00000100:00100000:0.0:1787784545.690382:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634737792 00000100:00100000:0.0:1787784545.691230:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:0.0:1787784545.691243:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634737792:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787784545.691279:0:8617:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787784545.692305:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634737792:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 1059us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.692318:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:3.0:1787784545.701156:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.705479:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738048 00000100:00100000:0.0:1787784545.705501:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738048 00000100:00100000:0.0:1787784545.705562:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:0.0:1787784545.705573:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634738048:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784545.705594:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784545.705598:0:8618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787784545.705623:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb53c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849abff expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.705640:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784545.705645:0:8618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784545.705658:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb590 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac14 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784545.707081:0:8618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787784545.707895:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.707914:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.707925:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.707999:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb590 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac14 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.708018:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac14 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.708040:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff943183fdcd00) 00010000:00010000:0.0:1787784545.708043:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784545.708046:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784545.708218:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11548:x1874627634738048:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2644us (7068us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787784545.708229:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:1.0:1787784545.716068:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.716536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738304 00000100:00100000:3.0:1787784545.716545:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738304 00000100:00100000:3.0:1787784545.716598:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:3.0:1787784545.716609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9430833b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11548:x1874627634738304:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784545.716673:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784545.716702:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac14 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716722:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff943183fdcd00) 00010000:00010000:3.0:1787784545.716732:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784545.716762:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716789:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716802:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716810:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.716817:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717051:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717059:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717066:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717072:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784545.717076:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717084:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717526:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:3.0:1787784545.717532:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784545.717538:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717546:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb5a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717557:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717563:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717570:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717576:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784545.717580:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717587:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717597:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x824c5e8b (ffff94319746ee00) 00010000:00010000:3.0:1787784545.717599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784545.717602:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.717608:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611200/0xffb8d925c20bb5ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x824c5e8b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784545.717710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9430833b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634738304:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1101us (1649us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784545.717719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:2.0:1787784545.728489:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.728700:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738432 00000100:00100000:3.0:1787784545.728711:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738432 00000100:00100000:3.0:1787784545.728769:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:3.0:1787784545.728779:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11548:x1874627634738432:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784545.728799:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784545.728820:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb5b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac1b expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.728871:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.728886:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.728897:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.728993:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610200/0xffb8d925c20bb5b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 60 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.729011:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 59 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.729019:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:3.0:1787784545.729029:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784545.729034:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611000, rc 0) 00000100:00100000:3.0:1787784545.729091:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11548:x1874627634738432:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 313us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784545.729099:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:3.0:1787784545.733195:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.733808:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738688 00000100:00100000:0.0:1787784545.733818:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738688 00000100:00100000:0.0:1787784545.733894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 178 00000100:00100000:0.0:1787784545.733905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11548:x1874627634738688:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787784545.733993:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.734011:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.734024:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784545.734358:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787784545.734476:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360561110169ns, next at 361561106373ns, rc = 0 00000004:00010000:0.0:1787784545.734577:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce5a60b0 reply state 00000000b285add8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784545.734587:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784545.734689:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11548:x1874627634738688:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 784us (1504us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787784545.734711:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 178 00010000:00010000:3.0:1787784545.747803:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747823:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747832:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747838:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784545.747852:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747860:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747877:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:3.0:1787784545.747880:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787784545.747884:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.747891:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb5c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784545.748631:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:0.0:1787784545.748660:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:0.0:1787784545.748683:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1787784545.748695:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1787784545.748721:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787784545.748730:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431887efb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787784545.748734:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318607f500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9431887ef600 00000020:00080000:0.0:1787784545.748737:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94318607ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431befae000 00000001:00080000:0.0:1787784545.748751:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:0.0:1787784545.748776:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787784545.748956:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787784545.749359:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784545.749559:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943186e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643128960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787784545.749636:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784545.749704:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643128960 00000100:00100000:3.0:1787784545.749711:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643128960 00000100:00100000:3.0:1787784545.749757:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787784545.749768:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643128960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787784545.749795:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1787784545.749828:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f6d5e, atime: 0x6a8f6d5e, ctime: 0x6a8f6d5e, blocks: 0x1 00010000:00010000:3.0:1787784545.749837:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.749888:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1787784545.749893:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784545.749900:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.749919:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.749931:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.749939:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.749966:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784545.750293:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.750321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738816 00000100:00100000:0.0:1787784545.750325:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738816 00000100:00100000:0.0:1787784545.750362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 179 00000100:00100000:0.0:1787784545.750390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11548:x1874627634738816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784545.750413:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784545.750429:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac22 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.750484:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.750498:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.750532:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:0.0:1787784545.750535:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784545.750539:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89600, rc 0) 00000100:00100000:0.0:1787784545.750591:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11548:x1874627634738816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 201us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.750598:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 179 00010000:00010000:2.0:1787784545.752513:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784545.752525:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784545.752539:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784545.752545:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784545.752557:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784545.752577:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784545.752586:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bb5c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784545.752618:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784545.752620:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784545.752622:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784545.754338:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3294:x1874627643128960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4563us (4694us total) trans 4294967307 rc 0/0 00000004:00080000:0.0:1787784545.754725:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943186e0f480/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787784545.754732:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943186e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643128960:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787784545.755255:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784545.768324:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.768552:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634738944 00000100:00100000:3.0:1787784545.768562:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634738944 00000100:00100000:3.0:1787784545.768662:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1787784545.768672:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634738944:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787784545.769017:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634738944:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 346us (700us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787784545.769026:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784545.775655:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.775758:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634739200 00000100:00100000:3.0:1787784545.775768:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634739200 00000100:00100000:3.0:1787784545.775836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1787784545.775858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11548:x1874627634739200:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787784545.776212:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11548:x1874627634739200:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 258us (459us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787784545.776220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00080000:1.0:1787784545.776902:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784545.779634:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784545.779710:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634739456 00000100:00100000:2.0:1787784545.779720:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634739456 00000100:00100000:2.0:1787784545.779788:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:2.0:1787784545.779799:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11548:x1874627634739456:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784545.779918:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11548:x1874627634739456:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.779940:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:1.0:1787784545.783857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.783954:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634739584 00000100:00100000:0.0:1787784545.783963:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634739584 00000100:00100000:0.0:1787784545.784026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 181 00000100:00100000:0.0:1787784545.784037:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11548:x1874627634739584:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784545.784058:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784545.784078:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb5d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac29 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784154:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784168:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784179:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784545.784223:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784545.784260:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784287:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb5d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac29 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784304:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac29 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.784312:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:0.0:1787784545.784315:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787784545.784318:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784545.784398:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634739584:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 363us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.784405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 181 00000100:00100000:0.0:1787784545.787459:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.787652:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634739712 00000100:00100000:3.0:1787784545.787664:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634739712 00000100:00100000:3.0:1787784545.787726:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1787784545.787737:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634739712:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787784545.787757:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784545.787780:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac30 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784545.787808:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6d62, blocks: 0x1 00010000:00010000:3.0:1787784545.787829:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1787784545.787855:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784545.787865:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.787885:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784545.787900:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611200, rc 0) 00000100:00100000:3.0:1787784545.787969:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634739712:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 234us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784545.787977:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:2.0:1787784545.795882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.796341:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634739968 00000100:00100000:3.0:1787784545.796351:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634739968 00000100:00100000:3.0:1787784545.796449:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 182 00000100:00100000:3.0:1787784545.796459:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634739968:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784545.796574:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634739968:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 116us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784545.796581:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 182 00000100:00100000:1.0:1787784545.809129:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.814496:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740096 00000100:00100000:0.0:1787784545.814512:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740096 00000100:00100000:1.0:1787784545.823573:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1787784545.823588:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:11548:x1874627634740096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784545.823609:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784545.823629:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac37 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784545.823667:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784545.823676:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784545.823679:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784545.823684:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784545.823717:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784545.823730:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784545.823744:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643129088:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784545.824426:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431850146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784545.838868:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431962a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643129088:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784545.838910:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.838934:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:2.0:1787784545.839074:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:11548:x1874627634740096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 15487us (29953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784545.839083:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1787784545.844148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.844237:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740224 00000100:00100000:0.0:1787784545.844256:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740224 00010000:00010000:0.0:1787784545.844306:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784545.844390:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:0.0:1787784545.844410:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2365:x1874627634740224:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784545.844426:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784545.844451:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.844468:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.844492:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e1fb29/0xffb8d925c20bb5e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac30 expref: 9 pid: 6679 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.844509:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784545.844514:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784545.844521:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.844533:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784545.844578:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784545.844593:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874627643129216:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784545.844693:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784545.867634:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784545.867679:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740352 00000100:00100000:3.0:1787784545.867688:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740352 00002000:00100000:3.0:1787784545.867739:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff943186e0d680 x1874627634740352/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:426/0 lens 504/0 e 0 to 0 dl 1787784556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784545.867751:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943186e0d680 with x1874627634740352 ext(0->8) 00002000:00010000:3.0:1787784545.867756:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff943186e0d680 00000100:00100000:3.0:1787784545.867787:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:3.0:1787784545.867795:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634740352:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787784545.868216:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:2363:x1874627634740352:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 420us (593us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787784545.868224:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00002000:00100000:3.0:1787784545.868230:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff943186e0d680 x1874627634740352/t4294967314(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:426/0 lens 504/448 e 0 to 0 dl 1787784556 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784545.868239:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff943186e0d680 with x1874627634740352 ext(0->8) 00002000:00010000:3.0:1787784545.868254:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff943186e0d680 00000100:00100000:0.0:1787784545.868734:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba342940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874627643129216:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784545.868764:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784545.868805:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2365:x1874627634740224:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 24399us (24669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784545.868814:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:1.0:1787784545.879195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784545.879227:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740480 00000100:00100000:1.0:1787784545.879235:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740480 00000100:00100000:1.0:1787784545.879298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 183 00000100:00100000:1.0:1787784545.879307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634740480:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787784545.911665:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784545.947857:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634740480:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 68529us (68647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784545.947872:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 183 00000020:00080000:2.0:1787784545.949987:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787784545.950091:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787784545.950099:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787784545.950133:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787784545.950614:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787784545.950630:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787784545.951281:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943197014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643129344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784545.951577:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784545.952182:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643129344 00000100:00100000:2.0:1787784545.952190:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643129344 00000100:00100000:2.0:1787784545.952265:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784545.952274:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643129344:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1787784545.952317:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787784545.952535:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787784545.952539:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787784546 00002000:00010000:0.0:1787784545.952542:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787784545.952544:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787784546 -> 1787784546 00002000:00010000:0.0:1787784545.952547:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787784545.952614:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643129344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (1037us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787784545.952622:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1787784545.952712:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943197014000/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787784545.952720:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943197014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643129344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787784545.953551:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784545.953853:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740608 00000100:00100000:0.0:1787784545.953859:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740608 00000100:00100000:0.0:1787784545.953906:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1787784545.953916:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2362:x1874627634740608:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787784546.003132:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1787784546.003162:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1787784546.003312:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634740608:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 49391us (49757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784546.003334:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:3.0:1787784546.008638:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784546.008930:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740864 00000100:00100000:1.0:1787784546.008940:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740864 00000100:00100000:1.0:1787784546.009008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 184 00000100:00100000:1.0:1787784546.009019:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11548:x1874627634740864:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784546.009077:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784546.009107:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb5dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac29 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.009126:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:1.0:1787784546.009131:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784546.009166:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.009180:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.009189:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787784546.009551:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9dcf912 reply state 000000009acb368d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784546.009579:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784546.009691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11548:x1874627634740864:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 673us (1063us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787784546.009699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 184 00010000:00010000:1.0:1787784546.011597:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011617:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011624:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011630:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784546.011636:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011644:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011659:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:1.0:1787784546.011663:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784546.011668:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784546.011674:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb5f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784546.012874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784546.013023:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634740992 00000100:00100000:0.0:1787784546.013033:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634740992 00000100:00100000:0.0:1787784546.013100:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1787784546.013112:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634740992:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787784546.013391:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787784546.013395:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787784546 -> 1787784544 00002000:00010000:0.0:1787784546.013408:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787784542 00002000:00010000:0.0:1787784546.013410:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787784546 -> 1787784544 00002000:00010000:0.0:1787784546.013413:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787784546.013482:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634740992:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 372us (643us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787784546.013490:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1787784546.018586:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784546.018686:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741248 00000100:00100000:2.0:1787784546.018697:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741248 00000100:00100000:2.0:1787784546.018759:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:2.0:1787784546.018769:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11548:x1874627634741248:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787784546.018866:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.018886:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 18 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.018896:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.018957:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 18 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.018971:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 18 pid: 8617 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.018985:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643129472:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784546.021788:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787784546.025020:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643129472:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784546.025052:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784546.026267:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784546.026396:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741376 00000100:00100000:2.0:1787784546.026406:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741376 00010000:00010000:2.0:1787784546.026449:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 19 pid: 8617 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.026486:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:2.0:1787784546.026497:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:2362:x1874627634741376:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784546.026513:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784546.026520:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 19 pid: 8617 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026535:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 19 pid: 8617 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026561:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611000/0xffb8d925c20bb5ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac1b expref: 19 pid: 8617 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026579:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:2.0:1787784546.026584:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026605:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026614:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.026641:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784546.026839:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026858:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026891:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026898:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026904:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026909:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784546.026913:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026920:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026929:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:3.0:1787784546.026932:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787784546.026936:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.026941:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb5f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.027055:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2362:x1874627634741376:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 559us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784546.027063:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:3.0:1787784546.027910:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:11548:x1874627634741248:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 9140us (9334us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787784546.027930:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:2.0:1787784546.031239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784546.031700:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741504 00000100:00100000:1.0:1787784546.031710:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741504 00000100:00100000:0.0:1787784546.031882:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:0.0:1787784546.031893:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634741504:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787784546.031944:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.031965:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.031975:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784546.031979:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784546.031984:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.032017:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.032032:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784546.032058:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643129600:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784546.032188:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784546.037462:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784546.037601:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741632 00000100:00100000:3.0:1787784546.037622:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741632 00010000:00010000:3.0:1787784546.037678:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 9 pid: 6678 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784546.037722:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:3.0:1787784546.037734:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634741632:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784546.037753:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784546.037778:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 9 pid: 6678 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.037794:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 9 pid: 6678 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.037822:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784546.037826:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784546.037831:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.037854:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.037878:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784546.037938:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634741632:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 206us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784546.037963:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1787784546.041858:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784546.041907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784546.041994:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784546.042029:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634742016 00000100:00100000:1.0:1787784546.042038:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634742016 00000100:00100000:3.0:1787784546.042432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741760 00000100:00100000:3.0:1787784546.042436:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741760 00000100:00100000:3.0:1787784546.042482:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 305 00000100:00100000:3.0:1787784546.042491:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634741760:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784546.042572:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2365:x1874627634741760:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 82us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784546.042580:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 305 00000100:00100000:1.0:1787784546.042785:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:1.0:1787784546.042796:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634742016:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784546.042828:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197015a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2365:x1874627634742016:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784546.042834:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00080000:1.0:1787784546.042865:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784546.043213:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634741888 00000100:00100000:0.0:1787784546.043218:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634741888 00000100:00100000:0.0:1787784546.043265:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:0.0:1787784546.043274:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634741888:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784546.043306:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2365:x1874627634741888:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 34us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784546.043312:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00010000:00010000:2.0:1787784546.043902:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb5eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac37 expref: 8 pid: 6678 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.043925:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643129600:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784546.043952:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.043964:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.043971:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044004:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044034:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044043:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044051:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784546.044055:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044065:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044084:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.044093:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000574ebfe8/0xffb8d925c20bb600 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.044178:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634741504:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 12286us (12947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784546.044186:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00080000:1.0:1787784546.046066:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784546.047907:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784546.048039:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634742272 00000100:00100000:3.0:1787784546.048049:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634742272 00000100:00100000:3.0:1787784546.048117:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 186 00000100:00100000:3.0:1787784546.048128:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+17:11548:x1874627634742272:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787784546.048214:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048232:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048245:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048661:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048673:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048682:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048729:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.048743:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 18 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784546.048757:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643129728:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784546.048836:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784546.051953:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643129728:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784546.051980:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784546.053153:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784546.053213:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634742400 00000100:00100000:2.0:1787784546.053220:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634742400 00010000:00010000:2.0:1787784546.053251:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 19 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.053294:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:2.0:1787784546.053301:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:2363:x1874627634742400:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784546.053314:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784546.053320:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 19 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053332:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 19 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053354:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb5cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac22 expref: 19 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053402:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:2.0:1787784546.053407:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053414:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053419:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.053441:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784546.053485:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634742400:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 185us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784546.053490:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00010000:00010000:3.0:1787784546.053540:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.053545:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784546.053729:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787784546.053887:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787784546.053935:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787784546.054004:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643129856:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784546.054052:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784546.054081:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431903779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784546.054226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643129856 00000100:00100000:2.0:1787784546.054238:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643129856 00000100:00100000:2.0:1787784546.054266:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784546.054271:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643129856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784546.054331:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643129856:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784546.054338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784546.054410:0:8617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787784546.054415:0:8617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943197014000, transno 4294967315 00000100:00100000:2.0:1787784546.054425:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643129856:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787784546.054895:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787784546.054954:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643129984:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784546.054998:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784546.055018:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784546.055032:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643129984 00000100:00100000:2.0:1787784546.055036:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643129984 00000100:00100000:2.0:1787784546.055057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784546.055063:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643129984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784546.055213:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8617:x1874627643129984:12345-0@lo:1000:mdt00_003.0 Request processed in 149us (213us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787784546.055219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784546.055247:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643129984:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787784546.055275:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055283:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055289:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055301:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784546.055305:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055313:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055327:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94319746ec00) 00010000:00010000:2.0:1787784546.055330:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784546.055334:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055339:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610000/0xffb8d925c20bb60e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055397:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055403:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055408:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055413:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784546.055415:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055420:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055437:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:2.0:1787784546.055439:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784546.055442:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055447:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610600/0xffb8d925c20bb543 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055466:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055478:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055487:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055508:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.055521:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 21 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784546.055531:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643130112:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784546.055578:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ddda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784546.060299:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643130112:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784546.060336:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784546.062038:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784546.062256:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634742528 00000100:00100000:3.0:1787784546.062265:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634742528 00010000:00010000:3.0:1787784546.062307:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 22 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784546.062410:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:3.0:1787784546.062420:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2363:x1874627634742528:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784546.062436:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784546.062444:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 22 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062458:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 22 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062479:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb55f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac06 expref: 22 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062497:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:3.0:1787784546.062503:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062513:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062521:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784546.062542:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784546.062602:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:2363:x1874627634742528:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 183us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784546.062610:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00010000:00010000:0.0:1787784546.063807:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063821:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063835:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063853:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063861:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063866:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784546.063870:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063895:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063909:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:0.0:1787784546.063912:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784546.063916:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063924:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb615 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063938:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063944:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063949:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063953:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784546.063956:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063961:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063968:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746e200) 00010000:00010000:0.0:1787784546.063970:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784546.063973:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.063988:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611e00/0xffb8d925c20bb607 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784546.064254:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11548:x1874627634742272:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 16125us (16352us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787784546.064263:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 186 00000020:00080000:0.0:1787784546.064269:0:8617:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787784546.065051:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784546.065058:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784546.065594:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787784546.065602:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784546.068688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784546.068798:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634742784 00000100:00100000:0.0:1787784546.068808:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634742784 00000100:00100000:0.0:1787784546.068880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:0.0:1787784546.068890:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11548:x1874627634742784:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787784546.069614:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787784546.069718:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787784546.069764:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069781:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069794:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069802:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069810:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069816:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784546.069856:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784546.069956:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11548:x1874627634742784:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1066us (1277us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787784546.069966:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000020:00080000:0.0:1787784546.069972:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787784546.072945:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784546.072961:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.072973:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784546.072977:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.072987:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.073008:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff943183fdc800) 00010000:00010000:2.0:1787784546.073011:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787784546.073015:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.073021:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb61c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784546.073047:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784546.073049:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784546.073051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784546.932612:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787784547.227838:0:12111:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787784547.227868:0:12111:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000040:00080000:1.0:1787784547.596883:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784547.596896:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784547.596933:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787784547.596940:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784547.764001:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784547.774525:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634743040 00000100:00100000:3.0:1787784547.774540:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634743040 00000100:00100000:2.0:1787784547.775227:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:2.0:1787784547.775239:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:11567:x1874627634743040:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784547.775275:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784547.775294:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac3e expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787784547.775967:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784547.778276:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb62a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.778304:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.778320:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784547.778338:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787784547.778600:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac3e expref: 25 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.778617:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb62a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac3e expref: 24 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.778625:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784547.778628:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784547.778631:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501800, rc 0) 00000100:00100000:2.0:1787784547.778708:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11567:x1874627634743040:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 3471us (14717us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787784547.778717:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:3.0:1787784547.783577:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784547.783616:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634743168 00000100:00100000:3.0:1787784547.783627:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634743168 00000100:00100000:3.0:1787784547.783681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:3.0:1787784547.783691:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11567:x1874627634743168:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1787784547.783776:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.783794:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.783806:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.783821:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.783842:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.783849:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784142:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784152:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784172:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784547.784224:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784237:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784243:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784250:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784256:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784547.784260:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784267:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784278:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:3.0:1787784547.784281:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784547.784286:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784292:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784303:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784308:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784319:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784324:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784547.784327:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784333:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784340:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94319746e300) 00010000:00010000:3.0:1787784547.784342:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784547.784345:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784350:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610800/0xffb8d925c20bb63f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784393:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784401:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784407:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784412:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784547.784414:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784428:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784436:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff94319746ef00) 00010000:00010000:3.0:1787784547.784438:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784547.784441:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.784446:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185611400/0xffb8d925c20bb646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784547.784522:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11567:x1874627634743168:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 832us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784547.784530:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:2.0:1787784547.846303:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784547.847270:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634743424 00000100:00100000:1.0:1787784547.847280:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634743424 00000100:00100000:1.0:1787784547.847397:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:1.0:1787784547.847409:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11570:x1874627634743424:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784547.847429:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784547.847450:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb64d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac45 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847547:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847561:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847572:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847585:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847593:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847599:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847931:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847940:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.847949:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784547.847959:0:8617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787784547.848053:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848060:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848072:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848078:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784547.848082:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848090:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848102:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784547.848105:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784547.848109:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848115:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb654 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848126:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848132:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848137:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848142:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784547.848157:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848173:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848181:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943190486500) 00010000:00010000:1.0:1787784547.848184:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784547.848186:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848191:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb65b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848231:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb64d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 27 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848245:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 26 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784547.848251:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:1.0:1787784547.848253:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784547.848256:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784547.848335:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11570:x1874627634743424:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 929us (2042us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787784547.848344:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:3.0:1787784547.851640:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784547.856174:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634743552 00000100:00100000:2.0:1787784547.856192:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634743552 00000100:00100000:2.0:1787784547.856277:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:2.0:1787784547.856287:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11570:x1874627634743552:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1787784547.856390:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856410:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856423:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856454:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856461:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856468:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856474:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784547.856478:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856486:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856497:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784547.856500:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784547.856504:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.856521:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784547.856708:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11570:x1874627634743552:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 422us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784547.856717:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:2.0:1787784547.860878:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784547.861082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634743808 00000100:00100000:3.0:1787784547.861093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634743808 00000100:00100000:3.0:1787784547.861166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1787784547.861178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11570:x1874627634743808:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784547.861461:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:11570:x1874627634743808:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 284us (594us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787784547.861469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:2.0:1787784547.896511:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784547.896560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744064 00000100:00100000:3.0:1787784547.896571:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744064 00000100:00100000:2.0:1787784547.896690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 191 00000100:00100000:2.0:1787784547.896701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:11094:x1874627634744064:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784547.896728:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784547.896749:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac4c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.896868:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.896882:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 28 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.896891:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.896925:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 28 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.896939:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 28 pid: 8617 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784547.897221:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beeda940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643130240:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784547.897330:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784547.900106:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784547.900203:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744192 00000100:00100000:0.0:1787784547.900270:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744192 00010000:00010000:0.0:1787784547.900323:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 29 pid: 8617 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784547.900411:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:0.0:1787784547.900421:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:2362:x1874627634744192:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784547.900436:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784547.900443:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 29 pid: 8617 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.900457:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 29 pid: 8617 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.900480:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:0.0:1787784547.900485:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.900494:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.900503:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.900540:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784547.900877:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:2362:x1874627634744192:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 182us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784547.900888:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00010000:00010000:2.0:1787784547.901360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac45 expref: 28 pid: 8617 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784547.901409:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beeda940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643130240:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784547.901472:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.901480:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.901484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784547.901502:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787784547.901655:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.901671:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.901680:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784547.901683:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784547.901686:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784547.901770:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:11094:x1874627634744064:12345-192.168.202.59@tcp:101:bash.0 Request processed in 5072us (5271us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787784547.901789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 191 00000100:00100000:3.0:1787784547.903654:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784547.903767:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744448 00000100:00100000:2.0:1787784547.903777:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744448 00000100:00100000:2.0:1787784547.903845:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 192 00000100:00100000:2.0:1787784547.903855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:11094:x1874627634744448:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1787784547.904298:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.904311:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784547.904319:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784547.904460:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787784547.904484:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9fbb525 reply state 0000000038944114 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784547.904490:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787784547.904526:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787784547.904605:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11094:x1874627634744448:12345-192.168.202.59@tcp:36:bash.0 Request processed in 750us (958us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787784547.904613:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 192 00000020:00080000:2.0:1787784547.904618:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787784547.906434:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784547.906478:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744576 00000100:00100000:0.0:1787784547.906488:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744576 00000100:00100000:0.0:1787784547.906549:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 193 00000100:00100000:0.0:1787784547.906560:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11094:x1874627634744576:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1787784547.906584:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784547.906604:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac53 expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.906665:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac53 expref: 33 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.906678:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac53 expref: 33 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784547.906698:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:0.0:1787784547.906702:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784547.906705:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88000, rc 0) 00000100:00100000:0.0:1787784547.906771:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+33:11094:x1874627634744576:12345-192.168.202.59@tcp:101:bash.0 Request processed in 213us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784547.906778:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 193 00010000:00010000:3.0:1787784547.907000:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907030:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907037:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907043:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784547.907047:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907054:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907066:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:3.0:1787784547.907069:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784547.907072:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.907077:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb68c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784547.909464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784547.909505:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744704 00000100:00100000:3.0:1787784547.909514:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744704 00000100:00080000:1.0:1787784547.909566:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784547.909630:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:3.0:1787784547.909641:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:11094:x1874627634744704:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784547.909658:0:8198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784547.909676:0:8198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac5a expref: -99 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784547.909702:0:8198:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6d60, atime: 0x6a8f6d5e, ctime: 0x6a8f6d60, blocks: 0xb 00010000:00010000:3.0:1787784547.909740:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1787784547.909744:0:8198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784547.909751:0:8198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 8 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.909770:0:8198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 8 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784547.909781:0:8198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610400, rc 0) 00000100:00100000:3.0:1787784547.909858:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:11094:x1874627634744704:12345-192.168.202.59@tcp:101:bash.0 Request processed in 219us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784547.909866:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:2.0:1787784547.913271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784547.913470:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744832 00000100:00100000:0.0:1787784547.913482:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744832 00002000:00010000:0.0:1787784547.913545:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787784547.913550:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431beeda940 with x1874627634744832 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784547.913563:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431beeda940. 00000100:00100000:0.0:1787784547.913591:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:0.0:1787784547.913601:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2365:x1874627634744832:12345-192.168.202.59@tcp:10:bash.0 00002000:00010000:0.0:1787784547.913898:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787784547.913903:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787784544 -> 1787784548 00002000:00010000:0.0:1787784547.913906:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787784542 -> 1787784542 00002000:00010000:0.0:1787784547.913909:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787784544 -> 1787784548 00002000:00010000:0.0:1787784547.913911:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787784547.915166:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beeda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2365:x1874627634744832:12345-192.168.202.59@tcp:10:bash.0 Request processed in 1557us (1898us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787784547.915179:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00002000:00010000:0.0:1787784547.915185:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787784547.915188:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431beeda940 with x1874627634744832 ext(0->18446744073709551615) 00002000:00010000:0.0:1787784547.915197:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431beeda940. 00010000:00010000:2.0:1787784547.961232:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784548.083675:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.085293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634744960 00000100:00100000:2.0:1787784548.085308:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634744960 00000100:00100000:2.0:1787784548.085438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:2.0:1787784548.085464:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11584:x1874627634744960:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1787784548.085547:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085567:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085578:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085594:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085602:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085608:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085914:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085924:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085932:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784548.085976:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.085988:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086000:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086006:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086012:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.086015:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086022:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086034:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784548.086037:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.086041:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086047:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086060:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086066:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086072:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086077:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.086086:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086092:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086100:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923700) 00010000:00010000:2.0:1787784548.086103:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.086106:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086128:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086135:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086141:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086734:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.086738:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086745:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086756:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784548.086758:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.086769:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.086775:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.086899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11584:x1874627634744960:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1434us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.086908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:1.0:1787784548.138909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.139046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634745216 00000100:00100000:2.0:1787784548.139057:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634745216 00000100:00100000:2.0:1787784548.139119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00100000:2.0:1787784548.139130:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+32:11587:x1874627634745216:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784548.139163:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784548.139188:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac61 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139277:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139291:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139302:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139318:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139325:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.139343:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140105:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140117:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140126:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784548.140136:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787784548.140256:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140264:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140271:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140278:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.140282:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140289:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140300:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784548.140303:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.140315:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140334:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140340:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140345:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140350:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.140353:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140360:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140792:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923700) 00010000:00010000:2.0:1787784548.140795:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.140799:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.140805:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.141087:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb6b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac61 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.141105:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac61 expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.141112:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:3.0:1787784548.141114:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787784548.141117:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501c00, rc 0) 00000100:00100000:3.0:1787784548.141210:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11587:x1874627634745216:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 2081us (2313us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787784548.141227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00100000:3.0:1787784548.151235:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784548.151263:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643130368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784548.151356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784548.151730:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643130368 00000100:00100000:2.0:1787784548.151739:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643130368 00000100:00100000:2.0:1787784548.151811:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787784548.151839:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643130368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784548.151881:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784548.151944:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643130368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.151963:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787784548.152141:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643130368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787784548.152205:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784548.153438:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784548.153513:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634745344 00000100:00100000:0.0:1787784548.153520:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634745344 00000100:00100000:0.0:1787784548.153567:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:0.0:1787784548.153577:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11587:x1874627634745344:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784548.153638:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.153655:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.153677:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.153708:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.153720:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 34 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784548.153734:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba23f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643130496:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784548.153812:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784548.159622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784548.159715:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634745600 00000100:00100000:1.0:1787784548.159724:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634745600 00000100:00100000:1.0:1787784548.159781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:1.0:1787784548.159791:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:5606:x1874627634745600:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787784548.160195:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:5606:x1874627634745600:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 404us (583us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787784548.160203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:2.0:1787784548.161293:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba23f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643130496:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784548.161323:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784548.167333:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.167563:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634745728 00000100:00100000:3.0:1787784548.167571:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634745728 00010000:00010000:3.0:1787784548.167612:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 36 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.167653:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:3.0:1787784548.167662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:2362:x1874627634745728:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784548.167678:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784548.167686:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 36 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167699:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 36 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167721:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb67e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac4c expref: 36 pid: 5833 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167736:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:3.0:1787784548.167741:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167750:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167756:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.167788:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784548.167875:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:2362:x1874627634745728:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 213us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784548.167884:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00010000:00010000:2.0:1787784548.167965:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.167974:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168006:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168013:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168020:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168026:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.168029:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168037:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168053:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784548.168056:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784548.168060:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.168066:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb6d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.168121:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11587:x1874627634745344:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 14545us (14689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.168130:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:0.0:1787784548.173051:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784548.173709:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634745984 00000100:00100000:1.0:1787784548.173721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634745984 00000100:00100000:1.0:1787784548.173785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1787784548.173796:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+34:11587:x1874627634745984:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784548.174336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:11587:x1874627634745984:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 539us (1295us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787784548.174345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1787784548.332513:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.332681:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634746240 00000100:00100000:2.0:1787784548.332691:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634746240 00000100:00100000:2.0:1787784548.332751:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 197 00000100:00100000:2.0:1787784548.332762:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+35:11598:x1874627634746240:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1787784548.332787:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784548.332808:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac68 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332914:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332929:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332942:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332957:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332973:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.332981:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333308:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb6f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333318:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784548.333338:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787784548.333474:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333481:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333488:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333494:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.333498:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333505:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333691:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784548.333694:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.333699:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb6e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333718:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333724:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333730:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333734:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.333737:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333743:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333750:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923700) 00010000:00010000:2.0:1787784548.333752:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.333755:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333760:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb6ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb6e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac68 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333842:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac68 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.333851:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784548.333853:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784548.333856:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784548.333939:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11598:x1874627634746240:12345-192.168.202.59@tcp:101:cat.0 Request processed in 1178us (1436us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787784548.333947:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 197 00000100:00100000:0.0:1787784548.343229:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.344627:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634746496 00000100:00100000:3.0:1787784548.344643:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634746496 00000100:00100000:3.0:1787784548.344761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1787784548.344773:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11598:x1874627634746496:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:3.0:1787784548.345049:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:11598:x1874627634746496:12345-192.168.202.59@tcp:35:cat.0 Request processed in 278us (1831us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787784548.345058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:1.0:1787784548.422512:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.428046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634746752 00000100:00100000:3.0:1787784548.428062:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634746752 00000100:00100000:2.0:1787784548.430425:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:2.0:1787784548.430445:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:11599:x1874627634746752:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:2.0:1787784548.430509:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787784548.430538:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb6f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac68 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430561:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb6cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac61 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430574:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac53 expref: 36 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430586:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943190486700) 00010000:00010000:2.0:1787784548.430611:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784548.430634:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430648:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430657:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430671:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430678:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.430685:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.431005:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.431015:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.431022:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784548.432282:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787784548.432295:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363258929189ns, next at 364258926642ns, rc = 0 00010000:00010000:2.0:1787784548.432383:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432409:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432419:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432428:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432435:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432441:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432466:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784548.432488:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432495:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432501:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432507:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.432511:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432518:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432540:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183923b00) 00010000:00010000:2.0:1787784548.432542:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787784548.432546:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432553:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb711 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432690:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784548.432698:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432704:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784548.432708:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432714:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432722:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff943183923b00) 00010000:00010000:3.0:1787784548.432725:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787784548.432728:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432733:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb718 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.432760:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784548.432761:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784548.432763:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784548.432794:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432801:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432806:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432810:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.432813:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432845:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432855:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784548.432857:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.432860:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.432866:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb703 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784548.432888:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb9d314b reply state 00000000d7d11393 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.432895:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784548.433027:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+37:11599:x1874627634746752:12345-192.168.202.59@tcp:36:rm.0 Request processed in 2586us (10523us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787784548.433036:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 198 00010000:00010000:1.0:1787784548.448945:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.448963:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.448971:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.448977:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784548.448982:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.449009:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.449027:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923700) 00010000:00010000:1.0:1787784548.449030:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784548.449035:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784548.449041:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb70a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784548.512733:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.512964:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747008 00000100:00100000:2.0:1787784548.512974:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747008 00000100:00100000:2.0:1787784548.513039:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 199 00000100:00100000:2.0:1787784548.513050:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+36:11605:x1874627634747008:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784548.513074:0:8617:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784548.513094:0:8617:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb71f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac6f expref: -99 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513228:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513243:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513254:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513268:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513275:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.513302:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787784548.513960:0:8617:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787784548.514140:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514152:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514160:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514197:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514204:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514210:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514216:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.514220:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514226:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514239:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784548.514242:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.514253:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514260:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb726 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784548.514274:0:8617:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c13b94f reply state 00000000771f3051 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.514283:0:8617:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784548.514313:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb71f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 39 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514327:0:8617:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 38 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.514334:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:2.0:1787784548.514336:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784548.514339:0:8617:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784548.514467:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:11605:x1874627634747008:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1418us (1746us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787784548.514475:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 199 00010000:00010000:2.0:1787784548.517911:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.517929:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.517937:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.517961:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784548.517967:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.517974:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.517991:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923d00) 00010000:00010000:2.0:1787784548.517993:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784548.517998:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.518005:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb72d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784548.518570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.518856:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747136 00000100:00100000:2.0:1787784548.518866:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747136 00000100:00100000:2.0:1787784548.518979:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:2.0:1787784548.518990:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431870f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634747136:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784548.519009:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784548.519029:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac76 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784548.519055:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784548.519077:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1787784548.519082:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784548.519092:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.519128:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.519140:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:2.0:1787784548.519261:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431870f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634747136:12345-192.168.202.59@tcp:101:bash.0 Request processed in 272us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.519269:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00080000:1.0:1787784548.526640:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784548.539594:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.545948:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747264 00000100:00100000:3.0:1787784548.545965:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747264 00000100:00100000:3.0:1787784548.546106:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:3.0:1787784548.546118:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:11605:x1874627634747264:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784548.546137:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784548.546156:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac7d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.546189:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.546198:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784548.546203:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784548.546208:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.546248:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.546263:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 7 pid: 6678 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.546276:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874627643130624:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784548.546829:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf7733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784548.556784:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.556873:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747392 00000100:00100000:2.0:1787784548.556883:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747392 00000100:00100000:3.0:1787784548.556901:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874627643130624:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784548.556924:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 8 pid: 6678 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.556930:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.556958:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611400, rc 0) 00000100:00100000:2.0:1787784548.556968:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:2.0:1787784548.556977:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634747392:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784548.556992:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784548.557016:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 8 pid: 6678 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.557028:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:11605:x1874627634747264:12345-192.168.202.59@tcp:101:bash.0 Request processed in 10914us (17446us total) trans 0 rc 0/0 00010000:00010000:2.0:1787784548.557029:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 8 pid: 6678 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.557036:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00010000:00010000:2.0:1787784548.557052:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070a1355e/0xffb8d925c20bb742 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac76 expref: 7 pid: 6678 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.557084:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784548.557090:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784548.557098:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.557109:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.557143:0:8443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.557157:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beed8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1874627643130752:192.168.202.59@tcp:105: 00000100:00100000:2.0:1787784548.557207:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787784548.572629:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.572738:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beed8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8443:1874627643130752:192.168.202.59@tcp:105: 00010000:00010000:2.0:1787784548.572762:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784548.572815:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2362:x1874627634747392:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 15839us (16042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.572838:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:0.0:1787784548.572925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747648 00000100:00100000:0.0:1787784548.572932:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747648 00000100:00100000:0.0:1787784548.572984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1787784548.572995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+38:11605:x1874627634747648:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1787784548.573336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:11605:x1874627634747648:12345-192.168.202.59@tcp:35:bash.0 Request processed in 343us (715us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787784548.573344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1787784548.888095:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784548.888445:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634747776 00000100:00100000:0.0:1787784548.888456:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634747776 00000100:00100000:0.0:1787784548.888533:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:0.0:1787784548.888561:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+39:11621:x1874627634747776:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784548.888591:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784548.888612:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb750 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac84 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888685:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888701:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888712:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784548.888778:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787784548.888782:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784548.888809:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888891:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb750 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac84 expref: 41 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888918:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac84 expref: 40 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.888927:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784548.888930:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784548.888935:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89600, rc 0) 00000100:00100000:0.0:1787784548.889302:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11621:x1874627634747776:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 742us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784548.889323:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:1.0:1787784548.901337:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784548.904430:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748032 00000100:00100000:2.0:1787784548.904444:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748032 00000100:00100000:2.0:1787784548.904531:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 201 00000100:00100000:2.0:1787784548.904542:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+40:11621:x1874627634748032:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784548.904564:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784548.904584:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb75e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac8b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.904715:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.904732:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.904743:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784548.904755:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787784548.904899:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb75e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac8b expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.904920:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac8b expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.904929:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:2.0:1787784548.904932:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784548.904936:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501600, rc 0) 00000100:00100000:2.0:1787784548.905012:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+42:11621:x1874627634748032:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 471us (3685us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787784548.905020:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 201 00000100:00100000:1.0:1787784548.919931:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784548.919980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784548.920068:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748416 00000100:00100000:3.0:1787784548.920071:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748160 00000100:00100000:0.0:1787784548.920077:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748416 00000100:00100000:3.0:1787784548.920078:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748160 00000100:00100000:0.0:1787784548.920141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:0.0:1787784548.920158:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11621:x1874627634748416:12345-192.168.202.59@tcp:101:lfs.0 00000100:00100000:3.0:1787784548.920211:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784548.920221:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:2362:x1874627634748160:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784548.920236:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784548.920261:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac8b expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.920279:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:3.0:1787784548.920284:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784548.920331:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787784548.920345:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+42:2362:x1874627634748160:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 124us (423us total) trans 0 rc 0/0 00010000:00010000:0.0:1787784548.920350:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac92 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.920355:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:0.0:1787784548.920510:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.920525:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.920537:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784548.920549:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787784548.920680:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac92 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.920697:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac92 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.920704:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:0.0:1787784548.920707:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787784548.920709:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784548.920764:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11621:x1874627634748416:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 609us (783us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787784548.920771:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:1.0:1787784548.938214:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.938702:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748544 00000100:00100000:3.0:1787784548.938714:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748544 00000100:00100000:3.0:1787784548.938782:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:3.0:1787784548.938793:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+6:2363:x1874627634748544:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:3.0:1787784548.938871:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.938892:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.938902:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784548.938906:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784548.938911:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.938952:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.938968:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 6 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.938983:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874627643130880:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784548.939100:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784548.944996:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874627643130880:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784548.945028:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784548.952804:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.953064:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748672 00000100:00100000:3.0:1787784548.953075:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748672 00002000:00100000:3.0:1787784548.953132:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9431bf673480 x1874627634748672/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:429/0 lens 504/0 e 0 to 0 dl 1787784559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784548.953158:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431bf673480 with x1874627634748672 ext(0->8) 00010000:00010000:3.0:1787784548.953168:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 7 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.953185:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 7 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784548.953194:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9431bf673480 00000100:00100000:3.0:1787784548.953233:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1787784548.953244:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634748672:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:3.0:1787784548.953956:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634748672:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 711us (1159us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787784548.953965:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00002000:00100000:3.0:1787784548.953974:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9431bf673480 x1874627634748672/t4294967308(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:429/0 lens 504/448 e 0 to 0 dl 1787784559 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784548.953983:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431bf673480 with x1874627634748672 ext(0->8) 00010000:00010000:3.0:1787784548.953989:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.954002:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784548.954010:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9431bf673480 00000100:00100000:1.0:1787784548.956705:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784548.959271:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634748800 00000100:00100000:0.0:1787784548.959288:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634748800 00010000:00010000:0.0:1787784548.959349:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784548.959554:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:0.0:1787784548.959565:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634748800:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784548.959585:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787784548.959620:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787784548.959625:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787784548 00002000:00010000:0.0:1787784548.959627:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787784549 00002000:00010000:0.0:1787784548.959629:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787784548 00010000:00010000:0.0:1787784548.959635:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.959652:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.959676:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005098438c/0xffb8d925c20bb749 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849ac7d expref: 9 pid: 6677 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.959693:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784548.959697:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784548.959702:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.959725:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.959761:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784548.959839:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634748800:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 276us (3143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784548.959846:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 75 00010000:00010000:3.0:1787784548.960744:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960764:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960789:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960794:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960800:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960804:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784548.960807:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960813:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960838:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.960845:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000831a1f01/0xffb8d925c20bb788 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.960944:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634748544:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 22149us (22736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784548.960953:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1787784548.964448:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.964539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749056 00000100:00100000:3.0:1787784548.964549:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749056 00000100:00100000:3.0:1787784548.964600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:3.0:1787784548.964619:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+43:11621:x1874627634749056:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:3.0:1787784548.964682:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac92 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784548.964982:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787784548.965020:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787784548.965654:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787784548.965713:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.965730:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 47 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.965738:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.965771:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 47 pid: 8617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784548.965785:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 47 pid: 8617 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784548.965812:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874627643131008:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784548.965913:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784548.968911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784548.969015:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fb9680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874627643131008:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784548.969046:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.969267:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749184 00000100:00100000:2.0:1787784548.969274:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749184 00010000:00010000:2.0:1787784548.969312:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 48 pid: 8617 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784548.969411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:2.0:1787784548.969437:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+48:2362:x1874627634749184:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784548.969457:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784548.969465:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 48 pid: 8617 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969478:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 48 pid: 8617 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969501:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500800/0xffb8d925c20bb734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ac6f expref: 48 pid: 8617 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969516:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:2.0:1787784548.969521:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969530:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969538:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784548.969565:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784548.969633:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+47:2362:x1874627634749184:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 198us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784548.969640:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00010000:00010000:0.0:1787784548.970121:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.970131:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784548.970274:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787784548.970511:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787784548.970830:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874627643131136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787784548.970906:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784548.970944:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787784548.971003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131136 00000100:00100000:1.0:1787784548.971009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131136 00000100:00100000:1.0:1787784548.971063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784548.971079:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874627643131136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787784548.971161:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874627643131136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784548.971168:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787784548.971586:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784548.971773:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787784548.971779:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1787784548.971801:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943186e0f480, transno 4294967307 00000100:00100000:0.0:1787784548.971830:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bfac4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874627643131136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787784548.974755:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787784548.974866:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874627643131264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787784548.974931:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784548.975234:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784548.975279:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131264 00000100:00100000:3.0:1787784548.975287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131264 00000100:00100000:3.0:1787784548.975392:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784548.975403:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874627643131264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787784548.975577:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bfac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874627643131264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 175us (645us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787784548.975584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787784548.975756:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874627643131264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787784548.975813:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787784548.975862:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975872:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975880:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975886:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784548.975891:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975899:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975915:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:0.0:1787784548.975918:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787784548.975923:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.975930:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb78f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784548.976142:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787784548.976234:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787784548.976246:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363802880827ns, next at 364802878571ns, rc = 0 00000001:00080000:0.0:1787784548.976253:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787784548.976297:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183923500) 00010000:00010000:0.0:1787784548.976301:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787784548.976307:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb77a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac92 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784548.976452:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:11621:x1874627634749056:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 11833us (12014us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787784548.976461:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000020:00080000:0.0:1787784548.976465:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787784548.979802:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784548.979889:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749312 00000100:00100000:0.0:1787784548.979899:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749312 00000100:00100000:0.0:1787784548.979963:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 203 00000100:00100000:0.0:1787784548.979973:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+50:11621:x1874627634749312:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784548.980000:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784548.980026:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ac99 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.980110:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac99 expref: 51 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.980125:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac99 expref: 51 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784548.980145:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784548.980149:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784548.980153:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784548.980222:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11621:x1874627634749312:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 249us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784548.980248:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 203 00010000:00010000:1.0:1787784548.981013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784548.984218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784548.984315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749568 00000100:00100000:1.0:1787784548.984326:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749568 00000100:00100000:1.0:1787784548.984426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1787784548.984437:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+51:11621:x1874627634749568:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784548.984710:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11621:x1874627634749568:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 275us (503us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787784548.984718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1787784549.058588:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.058688:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749696 00000100:00100000:0.0:1787784549.058700:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749696 00000100:00080000:1.0:1787784549.058797:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784549.058841:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:0.0:1787784549.058857:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11631:x1874627634749696:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1787784549.058936:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.058954:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.058965:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.058985:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.058993:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.058999:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059118:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059127:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059134:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787784549.059209:0:8617:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059223:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059230:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059238:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059257:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.059263:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059272:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059284:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784549.059287:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.059293:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059298:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb79d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059317:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059323:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059335:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059340:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.059343:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059349:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059356:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183fdc000) 00010000:00010000:0.0:1787784549.059359:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.059361:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059424:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059443:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059449:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059454:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059459:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.059462:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059479:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059489:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.059491:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.059494:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.059500:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784549.059583:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11631:x1874627634749696:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 727us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.059592:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:2.0:1787784549.111039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.111214:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634749952 00000100:00100000:0.0:1787784549.111225:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634749952 00000100:00100000:0.0:1787784549.111340:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 205 00000100:00100000:0.0:1787784549.111351:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+52:11634:x1874627634749952:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784549.111394:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784549.111417:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aca0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111495:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111513:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111524:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111554:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111562:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111568:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111718:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb7c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111727:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.111734:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784549.112218:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787784549.112331:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112340:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112347:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112353:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.112357:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112400:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112414:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784549.112417:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.112421:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112427:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb7b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112442:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112448:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112454:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112458:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.112461:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112466:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112473:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183fdc000) 00010000:00010000:0.0:1787784549.112476:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.112479:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb7c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112543:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca0 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112557:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca0 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.112565:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.112567:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784549.112570:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89e00, rc 0) 00000100:00100000:0.0:1787784549.112885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:11634:x1874627634749952:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1534us (2178us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787784549.112893:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 205 00000100:00100000:1.0:1787784549.117436:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784549.117637:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634750080 00000100:00100000:2.0:1787784549.117647:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634750080 00000100:00100000:2.0:1787784549.117731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:2.0:1787784549.117751:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:11634:x1874627634750080:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1787784549.117922:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.117940:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.117952:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.117984:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.117991:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.117998:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.118005:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784549.118009:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.118016:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.118028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784549.118031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784549.118035:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.118051:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784549.118134:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:11634:x1874627634750080:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 393us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784549.118142:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:1.0:1787784549.122555:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784549.122729:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634750336 00000100:00100000:3.0:1787784549.122747:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634750336 00000100:00100000:3.0:1787784549.122935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:3.0:1787784549.122948:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+54:11634:x1874627634750336:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1787784549.123212:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11634:x1874627634750336:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 266us (666us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787784549.125127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000040:00080000:3.0:1787784549.172706:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784549.172728:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784549.172841:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787784549.172852:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784549.249826:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784549.249976:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634750592 00000100:00100000:2.0:1787784549.249986:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634750592 00000100:00100000:2.0:1787784549.250050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 207 00000100:00100000:2.0:1787784549.250060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+55:11644:x1874627634750592:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784549.250085:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784549.250089:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787784549.250119:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89600/0xffb8d925c20bb757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac84 expref: 55 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250141:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784549.250146:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784549.250159:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aca7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250288:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb7e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250302:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250312:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb7e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784549.250334:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787784549.250527:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca7 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250542:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb7e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca7 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.250549:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784549.250552:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784549.250554:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501000, rc 0) 00000100:00100000:2.0:1787784549.250634:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11644:x1874627634750592:12345-192.168.202.59@tcp:101:bash.0 Request processed in 575us (833us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787784549.250642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 207 00000100:00100000:1.0:1787784549.256952:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.257051:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634750848 00000100:00100000:0.0:1787784549.257070:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634750848 00000100:00100000:0.0:1787784549.257140:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 208 00000100:00100000:0.0:1787784549.257151:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11644:x1874627634750848:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:0.0:1787784549.257210:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787784549.257240:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb7e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca7 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.257263:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb7c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aca0 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.257298:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.257304:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787784549.257578:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.257592:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.257855:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784549.257914:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787784549.257936:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000561b806 reply state 000000004ce2e024 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784549.257945:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787784549.258031:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11644:x1874627634750848:12345-192.168.202.59@tcp:36:bash.0 Request processed in 881us (1088us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787784549.258039:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 208 00000020:00080000:0.0:1787784549.258044:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787784549.261192:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261210:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261217:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261222:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784549.261240:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261247:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261263:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784549.261266:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784549.261270:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.261277:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88a00/0xffb8d925c20bb7f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784549.261829:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784549.261954:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634750976 00000100:00100000:2.0:1787784549.261964:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634750976 00000100:00100000:2.0:1787784549.262018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:2.0:1787784549.262029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+56:11644:x1874627634750976:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784549.262049:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784549.262066:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acae expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262163:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262199:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784549.262231:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787784549.262236:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784549.262257:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262284:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb7f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262298:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.262306:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784549.262308:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784549.262311:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500200, rc 0) 00000100:00100000:2.0:1787784549.262417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11644:x1874627634750976:12345-192.168.202.59@tcp:101:bash.0 Request processed in 389us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784549.262424:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:3.0:1787784549.268590:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.268881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634751232 00000100:00100000:0.0:1787784549.268892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634751232 00000100:00100000:0.0:1787784549.268956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:0.0:1787784549.268966:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+57:11644:x1874627634751232:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1787784549.269306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11644:x1874627634751232:12345-192.168.202.59@tcp:35:bash.0 Request processed in 341us (725us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787784549.269315:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:3.0:1787784549.334413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.334518:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634751360 00000100:00100000:0.0:1787784549.334544:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634751360 00000100:00100000:0.0:1787784549.334624:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:0.0:1787784549.334635:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+58:11649:x1874627634751360:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784549.334659:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784549.334680:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb806 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acb5 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334745:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334759:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334770:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784549.334846:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787784549.334851:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784549.334875:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334901:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb806 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acb5 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334922:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acb5 expref: 59 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.334931:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784549.334933:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784549.334937:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89200, rc 0) 00000100:00100000:0.0:1787784549.335012:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634751360:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 379us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.335019:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:1.0:1787784549.339092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.339181:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634751488 00000100:00100000:0.0:1787784549.339190:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634751488 00000100:00100000:0.0:1787784549.339259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:0.0:1787784549.339269:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634751488:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784549.339295:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784549.339320:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acbc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339442:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339458:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339482:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339497:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339589:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339797:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339805:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784549.339857:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787784549.339861:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784549.339881:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339895:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339904:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339910:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339916:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339922:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.339927:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339935:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339946:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784549.339948:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.339961:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339968:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88000/0xffb8d925c20bb81b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339982:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339988:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339994:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.339999:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784549.340003:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340007:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340012:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183fdc000) 00010000:00010000:0.0:1787784549.340014:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784549.340016:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340045:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bb814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acbc expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340064:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acbc expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.340069:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.340070:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784549.340072:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89800, rc 0) 00000100:00100000:0.0:1787784549.340315:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11649:x1874627634751488:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1045us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.340322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:3.0:1787784549.346166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784549.346260:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784549.346318:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634751872 00000100:00100000:2.0:1787784549.346326:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634751872 00000100:00100000:2.0:1787784549.346496:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784549.346505:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:2362:x1874627634751872:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784549.346520:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784549.346541:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bb829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acbc expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.346569:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784549.346573:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784549.346645:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:2362:x1874627634751872:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 140us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784549.346653:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784549.346755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634751744 00000100:00100000:1.0:1787784549.346760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634751744 00000100:00100000:1.0:1787784549.346797:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:1.0:1787784549.346804:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634751744:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784549.346834:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784549.346851:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acc3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.346954:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.346969:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.346977:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.347019:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.347031:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 60 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784549.347040:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9a9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643131392:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784549.347305:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185014b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784549.352320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.352476:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752000 00000100:00100000:0.0:1787784549.352486:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752000 00010000:00010000:0.0:1787784549.352531:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 61 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784549.352573:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:0.0:1787784549.352584:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:2362:x1874627634752000:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784549.352600:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784549.352621:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 61 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.352635:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 61 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.352657:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.352663:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.352685:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.352693:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.352714:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784549.352762:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:2362:x1874627634752000:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 180us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.352769:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00010000:00010000:1.0:1787784549.353844:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb7ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acae expref: 60 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784549.353864:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9a9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874627643131392:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784549.353877:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.353886:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.353892:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784549.353912:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787784549.354152:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bb830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.354169:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784549.354192:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784549.354195:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784549.354199:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512600, rc 0) 00000100:00100000:1.0:1787784549.354240:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11649:x1874627634751744:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 7436us (8084us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787784549.354247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:3.0:1787784549.357554:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.357613:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752256 00000100:00100000:0.0:1787784549.357624:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752256 00000100:00100000:0.0:1787784549.357695:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:0.0:1787784549.357705:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11649:x1874627634752256:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:0.0:1787784549.357722:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784549.357748:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bb796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac99 expref: 60 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.357770:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784549.357775:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784549.358322:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634752256:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 616us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.358332:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784549.360798:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784549.360891:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752384 00000100:00100000:0.0:1787784549.360901:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752384 00000100:00100000:0.0:1787784549.360959:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:0.0:1787784549.360968:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634752384:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:0.0:1787784549.361095:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.361111:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784549.361121:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787784549.361315:0:8617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787784549.361441:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634752384:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 473us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.361450:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:1.0:1787784549.364181:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784549.364269:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752512 00000100:00100000:2.0:1787784549.364279:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752512 00000100:00100000:2.0:1787784549.364398:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:2.0:1787784549.364410:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+59:11649:x1874627634752512:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784549.364430:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784549.364451:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acca expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364509:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364520:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364539:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364552:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364567:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784549.364584:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784549.364589:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 60 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784549.364597:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500000, rc 0) 00000100:00100000:2.0:1787784549.364874:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11649:x1874627634752512:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 466us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784549.364882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:3.0:1787784549.684779:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643131520:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.684873:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.684944:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643132032:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.684973:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.685001:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787784549.685007:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643131904:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685033:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.685060:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431918d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643131776:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.685119:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784549.685126:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643131648:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685153:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.685168:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643132160:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685188:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784549.685217:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643132032 00000100:00100000:3.0:1787784549.685224:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643132032 00000100:00100000:3.0:1787784549.685271:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131776 00000100:00100000:3.0:1787784549.685275:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131776 00000100:00100000:3.0:1787784549.685291:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131648 00000100:00100000:3.0:1787784549.685294:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131648 00000100:00100000:3.0:1787784549.685310:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787784549.685334:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643132032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685422:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643132032:12345-0@lo:400:kworker.0 Request processed in 88us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784549.685429:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787784549.685461:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787784549.685468:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685500:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1874627643131776:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784549.685506:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787784549.685518:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787784549.685523:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685549:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643131648:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784549.685554:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787784549.685596:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba343840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643131648:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685608:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431918d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3294:1874627643131776:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685645:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643132032:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685662:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131904 00000100:00100000:3.0:1787784549.685665:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131904 00000100:00100000:3.0:1787784549.685688:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643132160 00000100:00100000:3.0:1787784549.685692:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643132160 00000100:00100000:3.0:1787784549.685717:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787784549.685723:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643131904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685762:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319044e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1874627643131904:12345-0@lo:400:kworker.0 Request processed in 38us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784549.685779:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787784549.685792:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784549.685798:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643132160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685843:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1874627643132160:12345-0@lo:400:kworker.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784549.685849:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787784549.685882:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643132160:0@lo:400:kworker.0 00000100:00100000:3.0:1787784549.685908:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643131904:0@lo:400:kworker.0 00000100:00080000:1.0:1787784549.686248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784549.686445:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643131520 00000100:00100000:0.0:1787784549.686450:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643131520 00000100:00100000:0.0:1787784549.686498:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787784549.686506:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643131520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784549.686571:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643131520:12345-0@lo:400:kworker.0 Request processed in 66us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784549.686578:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787784549.686926:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643131520:0@lo:400:kworker.0 00010000:00010000:3.0:1787784550.004641:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787784550.200022:0:7915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365026654495ns, next at 366026650939ns, rc = 0 00000040:00080000:0.0:1787784550.200022:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784550.200032:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784550.200105:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000100:00100000:1.0:1787784550.200112:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000040:00080000:0.0:1787784550.200114:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787784550.200137:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431beedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643132288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784550.200216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784550.200239:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643132416:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787784550.200306:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784550.200489:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643132288 00000100:00100000:2.0:1787784550.200500:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643132288 00000100:00100000:2.0:1787784550.200560:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784550.200571:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643132288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784550.200618:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784550.200672:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643132288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.200679:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787784550.200726:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431beedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643132288:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787784550.201912:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787784550.206909:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784550.207709:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643132416:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787784550.207853:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752640 00000100:00100000:1.0:1787784550.207862:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752640 00000100:00100000:1.0:1787784550.207928:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:1.0:1787784550.207938:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11651:x1874627634752640:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787784550.207971:0:8617:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787784550.208075:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431884f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11651:x1874627634752640:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 138us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.208082:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:1.0:1787784550.212542:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.212643:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634752768 00000100:00100000:2.0:1787784550.212653:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634752768 00000100:00100000:2.0:1787784550.212711:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:2.0:1787784550.212722:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11651:x1874627634752768:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.212825:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212843:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212875:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212891:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212898:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212904:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212928:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212936:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.212943:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784550.212987:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787784550.212992:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784550.213007:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213020:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213026:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213045:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213052:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784550.213056:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213064:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213076:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:2.0:1787784550.213079:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784550.213083:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213089:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb853 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213102:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213108:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213114:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213118:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784550.213121:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213137:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213145:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff943183923d00) 00010000:00010000:2.0:1787784550.213148:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784550.213151:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213157:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb85a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213173:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213179:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213185:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213190:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784550.213192:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213198:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213204:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:2.0:1787784550.213206:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784550.213208:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.213224:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500200/0xffb8d925c20bb861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.213303:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11651:x1874627634752768:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 582us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.213311:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:3.0:1787784550.229320:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.229480:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634753024 00000100:00100000:1.0:1787784550.229492:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634753024 00000100:00100000:1.0:1787784550.229572:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:1.0:1787784550.229601:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+60:11651:x1874627634753024:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784550.229624:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784550.229645:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb868 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acd1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229743:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229758:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229770:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784550.229780:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787784550.229891:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229898:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229905:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229911:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784550.229914:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229921:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229932:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784550.229942:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787784550.229946:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229952:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb86f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.229993:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb868 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acd1 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.230003:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:1.0:1787784550.230006:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784550.230010:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb868 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acd1 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.230018:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784550.230090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431918d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753024:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 490us (780us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787784550.230097:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:3.0:1787784550.236854:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.237744:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634753152 00000100:00100000:2.0:1787784550.237767:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634753152 00000100:00100000:2.0:1787784550.237848:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:2.0:1787784550.237859:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753152:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784550.237899:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784550.238015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753152:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 157us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.238024:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:2.0:1787784550.247330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.247501:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634753408 00000100:00100000:1.0:1787784550.247511:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634753408 00000100:00100000:1.0:1787784550.247585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:1.0:1787784550.247596:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753408:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784550.247629:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784550.247632:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787784550.247660:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bb80d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acb5 expref: 61 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.247683:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784550.247702:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784550.247718:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb87d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acd8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787784550.248198:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787784550.248465:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.248479:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.248489:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.248540:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb87d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acd8 expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.248556:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acd8 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.248564:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943190486500) 00010000:00010000:1.0:1787784550.248567:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784550.248569:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:1.0:1787784550.248645:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+62:11651:x1874627634753408:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1050us (1327us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787784550.248653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:3.0:1787784550.254544:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.254697:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634753664 00000100:00100000:1.0:1787784550.254707:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634753664 00000100:00100000:1.0:1787784550.254766:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:1.0:1787784550.254777:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+62:11651:x1874627634753664:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784550.254883:0:8617:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784550.254911:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acd8 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.254932:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943190486500) 00010000:00010000:1.0:1787784550.254942:0:8617:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787784550.254966:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.254979:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.254988:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255002:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255009:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255016:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255095:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255103:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255109:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255120:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784550.255125:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255133:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255142:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784550.255145:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784550.255148:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255154:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bb892 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255164:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255169:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255174:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255178:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784550.255180:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255185:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255199:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x467d18c3 (ffff943190486800) 00010000:00010000:1.0:1787784550.255201:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784550.255204:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.255209:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb899 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x467d18c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.255294:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753664:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 518us (758us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784550.255301:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:3.0:1787784550.259640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.259762:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634753792 00000100:00100000:2.0:1787784550.259772:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634753792 00000100:00100000:2.0:1787784550.259847:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:2.0:1787784550.259858:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+61:11651:x1874627634753792:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.259882:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784550.259906:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acdf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.259943:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.259987:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.260001:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.260113:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.260132:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 62 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.260142:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.260145:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787784550.260149:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500e00, rc 0) 00000100:00100000:2.0:1787784550.260214:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+62:11651:x1874627634753792:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 358us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.260222:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:3.0:1787784550.263657:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.264090:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754048 00000100:00100000:2.0:1787784550.264102:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754048 00000100:00100000:2.0:1787784550.264174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 222 00000100:00100000:2.0:1787784550.264186:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+62:11651:x1874627634754048:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.264281:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.264302:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.264333:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784550.264641:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787784550.264651:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365091285314ns, next at 366091282741ns, rc = 0 00000004:00010000:2.0:1787784550.264756:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a76b2491 reply state 00000000beadcfaa transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.264766:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784550.266885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+64:11651:x1874627634754048:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 2691us (3227us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787784550.266898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 222 00010000:00010000:2.0:1787784550.272004:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272023:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272031:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272038:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784550.272044:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272052:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272082:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.272086:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787784550.272111:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.272119:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bb8ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784550.272903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.272971:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754176 00000100:00100000:2.0:1787784550.272989:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754176 00000100:00100000:2.0:1787784550.273047:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:2.0:1787784550.273057:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+63:11651:x1874627634754176:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.273091:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784550.273112:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ace6 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.273172:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 64 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.273186:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 64 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.273205:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.273208:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784550.273211:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500c00, rc 0) 00000100:00100000:2.0:1787784550.273568:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431962a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+64:11651:x1874627634754176:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 510us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.273577:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:1.0:1787784550.284734:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784550.284924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754304 00000100:00100000:3.0:1787784550.284935:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754304 00000100:00100000:3.0:1787784550.285027:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1787784550.285037:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2363:x1874627634754304:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787784550.285460:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784550.285761:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2363:x1874627634754304:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 724us (1036us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787784550.285770:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1787784550.289944:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.295759:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754560 00000100:00100000:1.0:1787784550.295778:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754560 00000100:00100000:1.0:1787784550.295924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:1.0:1787784550.295938:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+64:11651:x1874627634754560:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784550.296244:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+65:11651:x1874627634754560:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 308us (6309us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787784550.296253:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:2.0:1787784550.311689:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784550.312094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754816 00000100:00100000:0.0:1787784550.312123:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754816 00000100:00100000:0.0:1787784550.312192:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 224 00000100:00100000:0.0:1787784550.312203:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+65:11651:x1874627634754816:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787784550.312322:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+65:11651:x1874627634754816:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 121us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784550.312331:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 224 00000100:00100000:3.0:1787784550.314835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.315173:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634754944 00000100:00100000:2.0:1787784550.315184:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634754944 00000100:00100000:2.0:1787784550.315256:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:2.0:1787784550.315267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+65:11651:x1874627634754944:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.315291:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784550.315318:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb8bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aced expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315452:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315470:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784550.315542:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784550.315563:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500400/0xffb8d925c20bb8bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aced expref: 67 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315611:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aced expref: 66 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.315621:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.315624:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787784550.315628:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501000, rc 0) 00000100:00100000:2.0:1787784550.315825:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943196290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+66:11651:x1874627634754944:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 559us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.315844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:3.0:1787784550.322611:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.322915:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755072 00000100:00100000:2.0:1787784550.322927:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755072 00000100:00100000:2.0:1787784550.323002:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:2.0:1787784550.323014:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+10:2365:x1874627634755072:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.323036:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784550.323056:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acf4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784550.323211:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6d66, blocks: 0x1 00010000:00010000:2.0:1787784550.323233:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787784550.323239:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784550.323250:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.323272:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.323287:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:2.0:1787784550.323360:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:2365:x1874627634755072:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 340us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.323396:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:3.0:1787784550.341904:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.343336:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755328 00000100:00100000:2.0:1787784550.343413:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755328 00000100:00100000:2.0:1787784550.343662:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 226 00000100:00100000:2.0:1787784550.343675:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+66:11651:x1874627634755328:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787784550.344531:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+66:11651:x1874627634755328:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 855us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784550.349509:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.349616:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755456 00000100:00100000:1.0:1787784550.349635:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755456 00000100:00100000:1.0:1787784550.349704:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:1.0:1787784550.349715:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:11651:x1874627634755456:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784550.349738:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784550.349757:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849acfb expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.349828:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.349839:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784550.349844:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784550.349849:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.349889:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.349904:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.349919:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643132544:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784550.350029:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185014540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784550.352611:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 226 00000100:00100000:3.0:1787784550.353924:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.354158:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874627643132544:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784550.354195:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.354216:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784550.354284:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:11651:x1874627634755456:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4568us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.354294:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:0.0:1787784550.354399:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755584 00000100:00100000:0.0:1787784550.354406:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755584 00010000:00010000:0.0:1787784550.354443:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.354498:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:0.0:1787784550.354508:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2363:x1874627634755584:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784550.354524:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784550.354552:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.354566:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.354593:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c8bb52e/0xffb8d925c20bb8ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acf4 expref: 12 pid: 6678 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.354611:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784550.354616:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784550.354624:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.354644:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.354694:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.354710:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643132672:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784550.354787:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784550.362488:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874627643132672:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784550.362537:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784550.362613:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:2363:x1874627634755584:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 8106us (8694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784550.362628:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:3.0:1787784550.366098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784550.366417:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755712 00000100:00100000:0.0:1787784550.366428:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755712 00002000:00100000:0.0:1787784550.366496:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94319206c3c0 x1874627634755712/t0(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:431/0 lens 504/0 e 0 to 0 dl 1787784561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784550.366508:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94319206c3c0 with x1874627634755712 ext(0->12) 00002000:00010000:0.0:1787784550.366514:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94319206c3c0 00000100:00100000:0.0:1787784550.366548:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:0.0:1787784550.366560:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+11:2362:x1874627634755712:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787784550.368066:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2362:x1874627634755712:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 803us (1274us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787784550.368101:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00002000:00100000:0.0:1787784550.368118:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff94319206c3c0 x1874627634755712/t4294967320(0) o4->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:431/0 lens 504/448 e 0 to 0 dl 1787784561 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787784550.368128:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff94319206c3c0 with x1874627634755712 ext(0->12) 00002000:00010000:0.0:1787784550.368135:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff94319206c3c0 00000100:00100000:3.0:1787784550.388971:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.389891:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755840 00000100:00100000:1.0:1787784550.389906:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755840 00000100:00100000:1.0:1787784550.389981:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:1.0:1787784550.389992:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+66:11651:x1874627634755840:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787784550.502640:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:2.0:1787784550.502663:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787784550.502684:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94318916dd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787784550.502689:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bf12fb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94318916df00 00000020:00080000:2.0:1787784550.502692:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bf12f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431bf6fc400 00000001:00080000:2.0:1787784550.502716:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787784550.502742:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1787784550.502755:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787784550.502763:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787784550.502775:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787784550.502781:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff943186f9a300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787784550.502785:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431b3e61d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff943186f9a840 00000020:00080000:2.0:1787784550.502788:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431b3e61600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431beea3c00 00000100:00100000:0.0:1787784550.502951:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11651:x1874627634755840:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 112955us (113995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784550.502960:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943192068b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643132800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787784550.502963:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:2.0:1787784550.503029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784550.503096:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784550.503102:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643132928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787784550.503124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787784550.503131:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787784550.503308:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787784550.503396:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643132800 00000100:00100000:0.0:1787784550.503404:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643132800 00000100:00100000:0.0:1787784550.503460:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643132928 00000100:00100000:0.0:1787784550.503463:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643132928 00000100:00100000:0.0:1787784550.503483:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787784550.503492:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643132800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787784550.503518:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:3.0:1787784550.503534:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784550.503542:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3295:x1874627643132928:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787784550.503544:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.503565:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 12 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.503574:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787784550.503578:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787784550.503583:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.503627:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 12 pid: 8198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.503641:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 12 pid: 8198 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.503654:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643133056:192.168.202.59@tcp:104: 00002000:00010000:3.0:1787784550.503662:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787784550.503665:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787784550 00002000:00010000:3.0:1787784550.503667:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787784550.503670:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787784550 -> 1787784550 00002000:00010000:3.0:1787784550.503672:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787784550.503782:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d480 going to sleep for 11 seconds 00000100:00080000:2.0:1787784550.503893:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784550.503908:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643133184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787784550.511924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784550.512402:0:8198:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787784550.512414:0:8198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787784550.512718:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643133184 00000100:00100000:1.0:1787784550.512728:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643133184 00000100:00100000:0.0:1787784550.512894:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787784550.512905:0:12520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643133184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787784550.512938:0:12520:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787784550.512973:0:12520:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f6d64, atime: 0x6a8f6d65, ctime: 0x6a8f6d64, blocks: 0x1 00010000:00010000:0.0:1787784550.512993:0:12520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.513011:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1787784550.513016:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784550.513022:0:12520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.513038:0:12520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.513060:0:12520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.513068:0:12520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.513089:0:12520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784550.513709:0:12520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643133184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 803us (1790us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787784550.513719:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1787784550.513766:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943189163c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787784550.513771:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189163c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643133184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787784550.513967:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784550.513985:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.513996:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784550.514000:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.514010:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.514029:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.514037:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4c6237/0xffb8d925c20bb8df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.514055:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784550.514058:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784550.514059:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784550.514398:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1874627643132928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 10854us (11269us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787784550.514406:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1787784550.514498:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9431b9f02d00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787784550.514505:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643132928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787784550.514844:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.514916:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634755968 00000100:00100000:2.0:1787784550.514924:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634755968 00000100:00100000:2.0:1787784550.514980:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:2.0:1787784550.514989:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2363:x1874627634755968:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787784550.517278:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.517546:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874627643133056:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784550.517580:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784550.517707:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756096 00000100:00100000:3.0:1787784550.517715:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756096 00010000:00010000:3.0:1787784550.517754:0:8443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 14 pid: 8198 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784550.517794:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:3.0:1787784550.517813:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+14:2363:x1874627634756096:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784550.517829:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784550.517848:0:8443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 14 pid: 8198 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.517862:0:8443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 14 pid: 8198 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.517888:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006816752c/0xffb8d925c20bb69a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.59@tcp remote: 0x845202732849ac5a expref: 14 pid: 8198 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.517906:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784550.517910:0:8443:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787784550.517916:0:8443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.517928:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.517961:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784550.518096:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.518106:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.518118:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.518126:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.518150:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784550.518778:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784550.518787:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.518796:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784550.518812:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.518822:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.518837:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.518845:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014c8886c/0xffb8d925c20bb8d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.518865:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784550.518867:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784550.518869:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784550.519079:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1874627643132800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15586us (16048us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787784550.519089:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784550.519224:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+13:2363:x1874627634756096:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1420us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784550.519234:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000004:00080000:1.0:1787784550.522522:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943192068b40/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787784550.522537:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943192068b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643132800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787784550.558835:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189161e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+12:2363:x1874627634755968:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 43834us (43979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784550.558851:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000001:00080000:0.0:1787784550.558895:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1787784550.558918:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1787784550.563873:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.564056:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756352 00000100:00100000:2.0:1787784550.564066:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756352 00000100:00100000:2.0:1787784550.564144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 228 00000100:00100000:2.0:1787784550.564154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11651:x1874627634756352:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.564221:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784550.564252:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501000/0xffb8d925c20bb8c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aced expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.564271:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.564277:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784550.564311:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.564326:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.564336:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784550.564928:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f760987c reply state 00000000edcc4a52 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.564940:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784550.565770:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:11651:x1874627634756352:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1612us (1905us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787784550.565779:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 228 00010000:00010000:3.0:1787784550.572418:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572438:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572521:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572543:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784550.572549:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572557:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572575:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:3.0:1787784550.572578:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784550.572583:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.572590:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bb8e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.572756:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.572939:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756480 00000100:00100000:2.0:1787784550.572950:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756480 00000100:00100000:2.0:1787784550.573013:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:2.0:1787784550.573023:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634756480:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787784550.573303:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787784550.573314:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787784550 -> 1787784549 00002000:00010000:2.0:1787784550.573317:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787784549 00002000:00010000:2.0:1787784550.573319:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787784550 -> 1787784549 00002000:00010000:2.0:1787784550.573321:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787784550.573420:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634756480:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 398us (668us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787784550.573429:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1787784550.580792:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.580910:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756736 00000100:00100000:2.0:1787784550.580923:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756736 00000100:00100000:2.0:1787784550.581097:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:2.0:1787784550.581108:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:11651:x1874627634756736:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787784550.581185:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.581207:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.581218:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.581262:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.581279:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 20 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.581294:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643133312:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784550.581447:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784550.584500:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.584613:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643133312:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784550.584642:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.585257:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756864 00000100:00100000:1.0:1787784550.585285:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756864 00010000:00010000:1.0:1787784550.585326:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 21 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.585440:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:1.0:1787784550.585450:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:2362:x1874627634756864:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784550.585467:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784550.585475:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 21 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585489:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 21 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585518:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500e00/0xffb8d925c20bb8a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acdf expref: 21 pid: 5831 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585537:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:1.0:1787784550.585544:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585554:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585563:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.585587:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784550.585655:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed94780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:2362:x1874627634756864:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 206us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.585673:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00010000:00010000:2.0:1787784550.585730:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585738:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585773:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585780:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585787:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585794:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784550.585798:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585817:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585826:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:2.0:1787784550.585830:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787784550.585834:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.585841:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb8ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.585890:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11651:x1874627634756736:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 4784us (5109us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787784550.585899:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:3.0:1787784550.588675:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.588759:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634756992 00000100:00100000:1.0:1787784550.588773:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634756992 00000100:00100000:1.0:1787784550.588844:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:1.0:1787784550.588855:0:12520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2364:x1874627634756992:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787784550.588908:0:12520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.588934:0:12520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.588943:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784550.588948:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784550.588953:0:12520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.589038:0:12520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.589053:0:12520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 8 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.589070:0:12520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12520:1874627643133440:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784550.589162:0:12520:0:(client.c:2715:ptlrpc_set_wait()) set ffff943183b676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784550.591007:0:12520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12520:1874627643133440:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784550.591048:0:12520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784550.592332:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.592486:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634757120 00000100:00100000:1.0:1787784550.592501:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634757120 00010000:00010000:1.0:1787784550.592544:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.592590:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:1.0:1787784550.592599:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+9:2362:x1874627634757120:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784550.592614:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784550.592638:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.592653:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.592679:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c93b354/0xffb8d925c20bb8d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x845202732849acfb expref: 9 pid: 6679 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.592697:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784550.592701:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787784550.592708:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.592718:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.592754:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784550.592819:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634757120:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 220us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.592826:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00010000:00010000:0.0:1787784550.593022:0:12520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593033:0:12520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593060:0:12520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593076:0:12520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593085:0:12520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593092:0:12520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784550.593097:0:12520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593107:0:12520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593119:0:12520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.593126:0:12520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036e5a8e5/0xffb8d925c20bb8f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.593190:0:12520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2364:x1874627634756992:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 4337us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784550.593198:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:3.0:1787784550.602150:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784550.603096:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634757376 00000100:00100000:0.0:1787784550.603110:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634757376 00000100:00100000:0.0:1787784550.603185:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 230 00000100:00100000:0.0:1787784550.603214:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11651:x1874627634757376:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787784550.603309:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603329:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603342:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603620:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603632:0:8617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 20 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603642:0:8617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603679:0:8617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 20 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.603695:0:8617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 20 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.603711:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643133568:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784550.603835:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784550.606984:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.607109:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634757504 00000100:00100000:1.0:1787784550.607118:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634757504 00010000:00010000:1.0:1787784550.607157:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 21 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.607194:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:1.0:1787784550.607204:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:2363:x1874627634757504:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784550.607219:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784550.607225:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 21 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.607238:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 21 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.607265:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:1.0:1787784550.607270:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.607279:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.607287:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.607323:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784550.607401:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:2363:x1874627634757504:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 198us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.607408:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00010000:00010000:0.0:1787784550.607755:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bb8b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ace6 expref: 20 pid: 8618 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.607787:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643133568:192.168.202.59@tcp:104: 00010000:00010000:0.0:1787784550.607824:0:8617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.607833:0:8617:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.607839:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787784550.608112:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787784550.608256:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787784550.608295:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787784550.609151:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643133696:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787784550.609222:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784550.609259:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431963b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784550.609688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643133696 00000100:00100000:1.0:1787784550.609698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643133696 00000100:00100000:1.0:1787784550.609746:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784550.609754:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bed970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643133696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787784550.609884:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bed970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643133696:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.609893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784550.611678:0:8617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787784550.611692:0:8617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1787784550.611716:0:8617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9431b9f02d00, transno 4294967321 00000004:00080000:0.0:1787784550.611732:0:8617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943192068b40, transno 4294967322 00000100:00100000:0.0:1787784550.611741:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643133696:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787784550.612407:0:8617:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787784550.612507:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643133824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787784550.612588:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784550.612690:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784550.616698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643133824 00000100:00100000:3.0:1787784550.616717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643133824 00000100:00100000:3.0:1787784550.616791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787784550.616815:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8617:x1874627643133824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784550.617343:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8617:x1874627643133824:12345-0@lo:1000:mdt00_003.0 Request processed in 541us (4754us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787784550.617352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787784550.617643:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bed961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8617:1874627643133824:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787784550.617720:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617731:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617740:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617746:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784550.617751:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617759:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617777:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183923d00) 00010000:00010000:0.0:1787784550.617781:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784550.617787:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617794:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb902 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617853:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617860:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617866:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617883:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784550.617887:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617895:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617904:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784550.617907:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784550.617915:0:8617:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617927:0:8617:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.617937:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.618112:0:8617:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.618130:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643133952:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784550.618210:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318916d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787784550.625024:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.625157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634757632 00000100:00100000:1.0:1787784550.625168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634757632 00000100:00100000:1.0:1787784550.625234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1787784550.625260:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11649:x1874627634757632:12345-192.168.202.59@tcp:49:lfs.0 00000100:00100000:1.0:1787784550.625447:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+24:11649:x1874627634757632:12345-192.168.202.59@tcp:49:lfs.0 Request processed in 189us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.625455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1787784550.625945:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8617:1874627643133952:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784550.626040:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626068:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89e00/0xffb8d925c20bb845 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626103:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626117:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626127:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626135:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626141:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626147:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626152:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784550.626156:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626162:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626172:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784550.626175:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784550.626179:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626190:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bb909 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626200:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626205:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626211:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626216:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784550.626219:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626225:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626231:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784550.626233:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784550.626236:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.626240:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bb8fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784550.626932:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:11651:x1874627634757376:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 23716us (24786us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787784550.626944:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 230 00000020:00080000:0.0:1787784550.626958:0:8617:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787784550.627260:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784550.627270:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784550.627830:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787784550.627840:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784550.633035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784550.638873:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784550.638981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758144 00000100:00100000:0.0:1787784550.638993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758144 00000100:00100000:0.0:1787784550.639060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1787784550.639071:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+23:11651:x1874627634758144:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787784550.639897:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787784550.640011:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787784550.640217:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640236:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640250:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640260:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640268:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640276:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640306:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787784550.640575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:11651:x1874627634758144:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1503us (1713us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787784550.640585:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000020:00080000:0.0:1787784550.640590:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784550.640651:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784550.640666:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640672:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784550.640676:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640686:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640700:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff943183fdc100) 00010000:00010000:0.0:1787784550.640702:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787784550.640707:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bb910 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784550.640733:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784550.640735:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784550.640736:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784550.641622:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634757888 00000100:00100000:1.0:1787784550.641632:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634757888 00000100:00100000:1.0:1787784550.641726:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:1.0:1787784550.644998:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:11649:x1874627634757888:12345-192.168.202.59@tcp:58:lfs.0 00000040:00080000:1.0:1787784550.645303:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787784550.645437:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:11649:x1874627634757888:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 482us (12461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.645463:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:3.0:1787784550.689538:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.689657:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758272 00000100:00100000:2.0:1787784550.689666:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758272 00000100:00100000:2.0:1787784550.689729:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 232 00000100:00100000:2.0:1787784550.689740:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+25:11653:x1874627634758272:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784550.689766:0:8618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784550.689786:0:8618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb917 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad02 expref: -99 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689879:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689893:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689904:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689917:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689923:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.689929:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.690270:0:8618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.690284:0:8618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.690293:0:8618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.690329:0:8618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784550.690344:0:8618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 26 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784550.690357:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643134080:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784550.690504:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431864e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787784550.695679:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784550.695841:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b9f061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8618:1874627643134080:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784550.695874:0:8618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.696123:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758528 00000100:00100000:1.0:1787784550.696130:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758528 00000100:00100000:1.0:1787784550.696196:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:1.0:1787784550.696208:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:5607:x1874627634758528:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787784550.696523:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:5607:x1874627634758528:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 316us (854us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787784550.696530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:3.0:1787784550.699116:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784550.699348:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758656 00000100:00100000:1.0:1787784550.699402:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758656 00010000:00010000:1.0:1787784550.699455:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 28 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784550.699656:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:1.0:1787784550.699667:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:2362:x1874627634758656:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784550.699683:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784550.699691:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 28 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699705:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 28 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699729:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bb837 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849acc3 expref: 28 pid: 5833 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699749:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784550.699779:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699790:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699808:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784550.699853:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784550.699916:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:2362:x1874627634758656:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 250us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784550.699924:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00010000:00010000:3.0:1787784550.699989:0:8618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.699998:0:8618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784550.700049:0:8618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787784550.700055:0:8618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784550.700077:0:8618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700090:0:8618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700099:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700105:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700112:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700118:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784550.700130:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700138:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700147:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:3.0:1787784550.700150:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784550.700154:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700162:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500a00/0xffb8d925c20bb91e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700174:0:8618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700181:0:8618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700187:0:8618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700194:0:8618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784550.700196:0:8618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700203:0:8618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700212:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff943183923700) 00010000:00010000:3.0:1787784550.700214:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784550.700223:0:8618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700229:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bb925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700268:0:8618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bb917 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad02 expref: 27 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700282:0:8618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad02 expref: 26 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784550.700291:0:8618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784550.700293:0:8618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784550.700296:0:8618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501600, rc 0) 00000100:00100000:3.0:1787784550.700325:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11653:x1874627634758272:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 10588us (10799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784550.700332:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 232 00010000:00010000:1.0:1787784551.028818:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784551.164951:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784551.166969:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784551.167009:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784551.167033:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784551.167050:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759040 00000100:00100000:3.0:1787784551.167059:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784551.167071:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759040 00000100:00100000:3.0:1787784551.167080:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759296 00000100:00100000:3.0:1787784551.167083:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759296 00000100:00100000:3.0:1787784551.167120:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758912 00000100:00100000:2.0:1787784551.167120:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759168 00000100:00100000:3.0:1787784551.167123:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758912 00000100:00100000:2.0:1787784551.167123:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759168 00000100:00100000:3.0:1787784551.167144:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 179 00000100:00100000:2.0:1787784551.167144:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:3.0:1787784551.167153:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beedbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634759296:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784551.167153:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634759040:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784551.167246:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634759040:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.167254:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:2.0:1787784551.167278:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:2.0:1787784551.167286:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634759168:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784551.167398:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634758784 00000100:00100000:0.0:1787784551.167404:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634758784 00000100:00100000:1.0:1787784551.167484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:1.0:1787784551.167493:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:2362:x1874627634758912:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784551.167549:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 307 00000100:00100000:0.0:1787784551.167561:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634758784:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784551.169068:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba23f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634759168:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1771us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784551.169081:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00080000:2.0:1787784551.169148:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784551.169154:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784551.169631:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:2362:x1874627634758912:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 2136us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.169642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:3.0:1787784551.170647:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431beedbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2362:x1874627634759296:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1874us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784551.170667:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 179 00000100:00100000:0.0:1787784551.171092:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634758784:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3533us (6150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784551.171102:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 307 00000040:00080000:1.0:1787784551.442648:0:12558:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787784551.442659:0:12558:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787784551.442707:0:12558:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787784551.442716:0:12558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787784551.668604:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784551.668615:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784551.668650:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787784551.668657:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784551.668827:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643134208:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784551.668991:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784551.674957:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874627643134208:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784551.676908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784551.676992:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759424 00000100:00100000:3.0:1787784551.677003:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759424 00000100:00100000:3.0:1787784551.677072:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:3.0:1787784551.677083:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11665:x1874627634759424:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787784551.677117:0:8618:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787784551.677234:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11665:x1874627634759424:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 152us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784551.677242:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:3.0:1787784551.683541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784551.683652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759680 00000100:00100000:1.0:1787784551.683662:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759680 00000100:00100000:1.0:1787784551.683722:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:1.0:1787784551.683730:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+26:11665:x1874627634759680:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784551.683749:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784551.683779:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb933 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad09 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.683902:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb93a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.683918:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.683932:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb93a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784551.683944:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787784551.684302:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb933 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad09 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.684321:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb93a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad09 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.684330:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784551.684333:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784551.684527:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1400, rc 0) 00000100:00100000:0.0:1787784551.684718:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:11665:x1874627634759680:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 985us (1189us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787784551.684738:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:0.0:1787784551.690206:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784551.690277:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784551.690388:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760064 00000100:00100000:1.0:1787784551.690399:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760064 00000100:00100000:1.0:1787784551.690475:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1787784551.690485:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:2364:x1874627634760064:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784551.690502:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784551.690531:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1400/0xffb8d925c20bb93a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad09 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784551.690570:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784551.690576:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784551.690646:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:2364:x1874627634760064:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 163us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784551.690654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1787784551.691980:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634759936 00000100:00100000:3.0:1787784551.691993:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634759936 00000100:00100000:3.0:1787784551.692047:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 235 00000100:00100000:3.0:1787784551.692057:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+27:11665:x1874627634759936:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787784551.692136:0:8617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692506:0:8617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692533:0:8617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692746:0:8617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692754:0:8617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692761:0:8617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692767:0:8617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784551.692771:0:8617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692779:0:8617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692800:0:8617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784551.692803:0:8617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787784551.692808:0:8617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784551.692814:0:8617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8617 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784551.692984:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:11665:x1874627634759936:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 926us (2784us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787784551.692993:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 235 00000040:00080000:0.0:1787784551.693097:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784551.693101:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784551.693626:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787784551.693635:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787784551.696285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784551.696418:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760320 00000100:00100000:1.0:1787784551.696428:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760320 00000100:00100000:1.0:1787784551.696475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:1.0:1787784551.696485:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+28:11665:x1874627634760320:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784551.696904:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:11665:x1874627634760320:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 419us (630us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787784551.696913:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00010000:00010000:0.0:1787784552.052657:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787784552.302747:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787784552.302771:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:2.0:1787784553.078444:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784553.268996:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784553.269023:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643134336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784553.269320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784553.269511:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134336 00000100:00100000:3.0:1787784553.269519:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134336 00000100:00100000:3.0:1787784553.269583:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784553.269593:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643134336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784553.269629:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784553.269680:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643134336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784553.269687:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787784553.269820:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643134336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787784553.269974:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787784553.619439:0:12610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787784553.619450:0:12610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784553.619503:0:12610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787784553.619508:0:12610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787784553.917974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784553.923844:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760576 00000100:00100000:3.0:1787784553.923858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760576 00000100:00100000:3.0:1787784553.924026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 236 00000100:00100000:3.0:1787784553.924242:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+29:11686:x1874627634760576:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784553.924269:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784553.924293:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb94f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad10 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784553.924417:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784553.924430:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784553.924444:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784553.924455:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787784553.924583:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610400/0xffb8d925c20bb94f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad10 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784553.924612:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad10 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784553.924621:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:3.0:1787784553.924624:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787784553.924627:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610a00, rc 0) 00000100:00100000:3.0:1787784553.924696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:11686:x1874627634760576:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 459us (6732us total) trans 4294967519 rc 0/0 00000100:00080000:0.0:1787784553.924746:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784553.933609:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 236 00000100:00100000:3.0:1787784553.942866:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784553.943203:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760704 00000100:00100000:0.0:1787784553.943213:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760704 00000100:00100000:0.0:1787784553.943281:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 237 00000100:00100000:0.0:1787784553.943292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:11686:x1874627634760704:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1787784553.943385:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943401:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943413:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943444:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943464:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943471:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943478:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784553.943482:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943490:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943503:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:0.0:1787784553.943506:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784553.943511:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784553.943517:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bb964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784553.944029:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+31:11686:x1874627634760704:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 736us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784553.944037:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 237 00000100:00100000:2.0:1787784554.085289:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784554.085397:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760832 00000100:00100000:0.0:1787784554.085408:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760832 00000100:00100000:0.0:1787784554.085496:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:0.0:1787784554.085508:0:12520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634760832:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:0.0:1787784554.085527:0:12520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784554.085560:0:12520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4c6237/0xffb8d925c20bb96b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad17 expref: -99 pid: 12520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787784554.085587:0:12520:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f6d65, atime: 0x6a8f6d65, ctime: 0x6a8f6d65, blocks: 0xb 00010000:00010000:0.0:1787784554.085609:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1787784554.085613:0:12520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784554.085623:0:12520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4c6237/0xffb8d925c20bb96b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad17 expref: 8 pid: 12520 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784554.085642:0:12520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e4c6237/0xffb8d925c20bb96b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad17 expref: 8 pid: 12520 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784554.085655:0:12520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784554.085720:0:12520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2363:x1874627634760832:12345-192.168.202.59@tcp:101:cat.0 Request processed in 215us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784554.085727:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00080000:2.0:1787784554.085803:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784554.099334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784554.099474:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634760960 00000100:00100000:3.0:1787784554.099485:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634760960 00002000:00100000:3.0:1787784554.099540:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9431b45b6d00 x1874627634760960/t0(0) o3->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:435/0 lens 488/0 e 0 to 0 dl 1787784565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784554.099552:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b45b6d00 with x1874627634760960 ext(0->4095) 00002000:00010000:3.0:1787784554.099558:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b45b6d00 00000100:00100000:3.0:1787784554.099592:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784554.099603:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634760960:12345-192.168.202.59@tcp:3:cat.0 00000100:00100000:3.0:1787784554.099841:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+8:2362:x1874627634760960:12345-192.168.202.59@tcp:3:cat.0 Request processed in 239us (517us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787784554.099849:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00002000:00100000:3.0:1787784554.099856:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9431b45b6d00 x1874627634760960/t0(0) o3->f9a4fd2c-0c67-4cd1-a267-69f5c190cff9@192.168.202.59@tcp:435/0 lens 488/4536 e 0 to 0 dl 1787784565 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787784554.099864:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9431b45b6d00 with x1874627634760960 ext(0->4095) 00002000:00010000:3.0:1787784554.099881:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9431b45b6d00 00010000:00010000:0.0:1787784554.100589:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784554.805339:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643134592:0@lo:400:kworker.0 00000100:00100000:2.0:1787784554.805441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784554.805514:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643135104:0@lo:400:kworker.0 00000100:00100000:2.0:1787784554.805542:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784554.805576:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787784554.805583:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643134464:0@lo:400:kworker.0 00000100:00100000:2.0:1787784554.805614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784554.805651:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643134976:0@lo:400:kworker.0 00000100:00100000:2.0:1787784554.805675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784554.805705:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135104 00000100:00100000:2.0:1787784554.805712:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135104 00000100:00100000:2.0:1787784554.805780:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787784554.805790:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643135104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784554.805843:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643135104:12345-0@lo:400:kworker.0 Request processed in 54us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784554.805851:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787784554.805873:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784554.805901:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787784554.805907:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787784554.805928:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943189163c00, transno 4294967310 00000100:00100000:2.0:1787784554.805939:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643135104:0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806072:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643134720:0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806108:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784554.806137:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784554.806142:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643134848:0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806162:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784554.806196:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134464 00000100:00100000:3.0:1787784554.806199:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134464 00000100:00100000:3.0:1787784554.806231:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787784554.806238:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643134464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806274:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3296:x1874627643134464:12345-0@lo:400:kworker.0 Request processed in 36us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784554.806280:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787784554.806306:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134848 00000100:00100000:3.0:1787784554.806320:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134848 00000100:00100000:3.0:1787784554.806342:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784554.806348:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643134848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806402:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba301e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643134848:12345-0@lo:400:kworker.0 Request processed in 53us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784554.806408:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784554.806441:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643134848:0@lo:400:kworker.0 00000100:00100000:3.0:1787784554.806463:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3296:1874627643134464:0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.806593:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134592 00000100:00100000:1.0:1787784554.806598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134592 00000100:00100000:1.0:1787784554.806636:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134976 00000100:00100000:1.0:1787784554.806639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134976 00000100:00100000:1.0:1787784554.806664:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643134720 00000100:00100000:1.0:1787784554.806667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643134720 00000100:00100000:1.0:1787784554.806684:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787784554.806691:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643134592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.806733:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643134592:12345-0@lo:400:kworker.0 Request processed in 43us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784554.806739:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787784554.806776:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787784554.806783:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943190444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643134976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.806815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943190444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643134976:12345-0@lo:400:kworker.0 Request processed in 33us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784554.806821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787784554.806832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787784554.806838:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643134720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.806871:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643134720:12345-0@lo:400:kworker.0 Request processed in 34us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784554.806876:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1787784554.807067:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784554.807085:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643134720:0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.807108:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643134976:0@lo:400:kworker.0 00000100:00100000:1.0:1787784554.807118:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643134592:0@lo:400:kworker.0 00010000:00010000:1.0:1787784555.124635:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784555.316644:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784555.316671:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643135232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784555.316740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784555.316934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135232 00000100:00100000:0.0:1787784555.316943:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135232 00000100:00100000:0.0:1787784555.317000:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787784555.317017:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643135232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784555.317067:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784555.317129:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643135232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784555.317136:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787784555.317230:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643135232:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787784555.904636:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787784555.904656:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787784555.920314:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:2.0:1787784555.920333:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9431887ef9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787784555.920338:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bf12fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9431887ef600 00000020:00080000:2.0:1787784555.920342:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9431bf12f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9431bedef000 00000001:00080000:2.0:1787784555.920386:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:2.0:1787784555.920405:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787784555.920414:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787784555.920426:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787784555.921014:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787784556.148658:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784556.280842:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784556.280941:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784556.280977:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761088 00000100:00100000:3.0:1787784556.280978:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784556.280989:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761088 00000100:00100000:3.0:1787784556.281013:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784556.281039:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784556.281059:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 309 00000100:00100000:3.0:1787784556.281065:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761600 00000100:00100000:3.0:1787784556.281068:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761600 00000100:00100000:0.0:1787784556.281071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634761088:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784556.281110:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 184 00000100:00100000:3.0:1787784556.281117:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634761600:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784556.281198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761216 00000100:00100000:2.0:1787784556.281203:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761216 00000100:00100000:2.0:1787784556.281259:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:2.0:1787784556.281266:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634761216:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784556.281338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634761088:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 269us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784556.281347:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 309 00000100:00100000:3.0:1787784556.281538:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba300780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2363:x1874627634761600:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 421us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784556.281538:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761344 00000100:00100000:1.0:1787784556.281542:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761344 00000100:00100000:3.0:1787784556.281545:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 184 00000100:00080000:3.0:1787784556.281562:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784556.281567:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784556.281570:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761472 00000100:00100000:1.0:1787784556.281573:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761472 00000100:00100000:1.0:1787784556.281605:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:3.0:1787784556.281609:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:1.0:1787784556.281612:0:12520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634761344:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784556.281615:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba301a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634761472:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784556.281641:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba301a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634761472:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.281647:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00080000:3.0:1787784556.281682:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784556.283555:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba302d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634761216:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 2274us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784556.283571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:3.0:1787784556.289978:0:12520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba303480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634761344:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 8353us (9022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784556.289995:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 106 00010000:00010000:1.0:1787784557.172821:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784558.197677:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784558.388773:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784558.388872:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784558.388967:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135360 00000100:00100000:3.0:1787784558.388980:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135360 00000100:00100000:3.0:1787784558.389078:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787784558.389090:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643135360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784558.389142:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787784558.389249:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784558.389448:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643135360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 360us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784558.389456:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787784558.389606:0:3294:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787784558.389613:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787784558.389644:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643135360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784559.223780:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787784559.924801:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787784559.924812:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787784559.925398:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643135744:0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.925481:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784559.925546:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784559.925552:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643135872:0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.925580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784559.925616:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135744 00000100:00100000:3.0:1787784559.925622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135744 00000100:00100000:3.0:1787784559.925688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784559.925698:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643135744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.925777:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba302580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643135744:12345-0@lo:400:kworker.0 Request processed in 81us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784559.925784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787784559.925809:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135872 00000100:00100000:3.0:1787784559.925813:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135872 00000100:00100000:3.0:1787784559.925838:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787784559.925844:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643135872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.925873:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba3012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643135872:12345-0@lo:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784559.925880:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787784559.925895:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784559.925931:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba300f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643135872:0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.925942:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba303840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643135744:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926049:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643135488:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784559.926140:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643136000:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784559.926183:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784559.926188:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba300b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643135616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926210:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784559.926224:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643136128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784559.926273:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136000 00000100:00100000:1.0:1787784559.926277:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136000 00000100:00100000:1.0:1787784559.926309:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135616 00000100:00100000:1.0:1787784559.926312:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135616 00000100:00100000:1.0:1787784559.926328:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787784559.926335:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643136000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926392:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643136000:12345-0@lo:400:kworker.0 Request processed in 57us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784559.926398:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787784559.926410:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787784559.926416:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643135616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926441:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643135616:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784559.926447:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787784559.926462:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136128 00000100:00100000:1.0:1787784559.926465:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136128 00000100:00100000:1.0:1787784559.926491:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787784559.926497:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643136128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926526:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643136128:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784559.926541:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787784559.926560:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787784559.926563:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784559.926581:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba300b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643135616:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926591:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba302940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643136128:0@lo:400:kworker.0 00000100:00100000:1.0:1787784559.926600:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643136000:0@lo:400:kworker.0 00000040:00080000:0.0:1787784559.926930:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787784559.926941:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787784559.927332:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643135488 00000100:00100000:3.0:1787784559.927338:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643135488 00000100:00100000:3.0:1787784559.927491:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787784559.927500:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643135488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784559.927559:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643135488:12345-0@lo:400:kworker.0 Request processed in 61us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784559.927565:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787784559.927734:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba301680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643135488:0@lo:400:kworker.0 00000100:00100000:3.0:1787784560.032945:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784560.033129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761728 00000100:00100000:0.0:1787784560.033141:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761728 00000100:00100000:0.0:1787784560.033222:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 238 00000100:00100000:0.0:1787784560.033237:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11330:x1874627634761728:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787784560.033636:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba303840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11330:x1874627634761728:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 Request processed in 403us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784560.033645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 238 00000100:00080000:1.0:1787784560.034800:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784560.036201:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784560.036472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634761984 00000100:00100000:1.0:1787784560.036483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634761984 00000100:00100000:1.0:1787784560.036541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:1.0:1787784560.036551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:11330:x1874627634761984:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787784560.037152:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:11330:x1874627634761984:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 602us (958us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787784560.037161:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00010000:00010000:0.0:1787784560.244858:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784560.377616:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784560.377777:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762112 00000100:00100000:1.0:1787784560.377788:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762112 00000100:00100000:1.0:1787784560.377874:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 239 00000100:00100000:1.0:1787784560.377885:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:12139:x1874627634762112:12345-192.168.202.59@tcp:101:lsof.0 00000100:00080000:3.0:1787784560.377892:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787784560.377906:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784560.377927:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad1e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378011:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378042:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378051:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784560.378224:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787784560.378227:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784560.378297:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378323:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1a00/0xffb8d925c20bb972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad1e expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378338:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad1e expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784560.378346:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:1.0:1787784560.378349:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784560.378353:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784560.378470:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:12139:x1874627634762112:12345-192.168.202.59@tcp:101:lsof.0 Request processed in 587us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784560.378479:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 239 00000100:00100000:0.0:1787784560.436736:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787784560.436775:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431971170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784560.437061:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784560.438086:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136256 00000100:00100000:3.0:1787784560.438097:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136256 00000100:00100000:3.0:1787784560.438161:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787784560.438171:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784560.438212:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784560.438287:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784560.438295:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787784560.438466:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431971170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136256:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787784560.995163:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787784560.995179:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787784560.995235:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787784560.995246:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787784561.268634:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784561.401559:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784561.401621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784561.401643:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762368 00000100:00100000:2.0:1787784561.401656:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762368 00000100:00100000:3.0:1787784561.401671:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784561.401729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784561.401757:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:3.0:1787784561.401763:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784561.401776:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634762368:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784561.401790:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762624 00000100:00100000:3.0:1787784561.401795:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762624 00000100:00100000:3.0:1787784561.401835:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762496 00000100:00100000:3.0:1787784561.401845:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762496 00000100:00100000:2.0:1787784561.401875:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba300f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2363:x1874627634762368:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784561.401876:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:3.0:1787784561.401890:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634762624:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784561.401891:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:2.0:1787784561.401917:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762752 00000100:00100000:2.0:1787784561.401922:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762752 00000100:00100000:3.0:1787784561.401928:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba303c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2363:x1874627634762624:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 41us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784561.401937:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:2.0:1787784561.401953:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:3.0:1787784561.401958:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:3.0:1787784561.401968:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634762496:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784561.401976:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2363:x1874627634762752:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784561.401998:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba301680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2363:x1874627634762496:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 31us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784561.402005:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:2.0:1787784561.402016:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2363:x1874627634762752:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00080000:3.0:1787784561.402026:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784561.402026:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00080000:3.0:1787784561.402033:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784561.402114:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762240 00000100:00100000:1.0:1787784561.402119:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762240 00000100:00100000:1.0:1787784561.402153:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 311 00000100:00100000:1.0:1787784561.402167:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634762240:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784561.402194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2363:x1874627634762240:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784561.402201:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 311 00010000:00010000:0.0:1787784562.295797:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784563.317449:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784563.515533:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784563.515615:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:02000400:3.0:1787784563.516074:0:12811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:49:22 (1787784562) 00000100:00100000:2.0:1787784563.516330:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136384 00000100:00100000:2.0:1787784563.516338:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136384 00000100:00100000:2.0:1787784563.516417:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787784563.516436:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787784563.516481:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787784563.516563:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784563.518959:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2523us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784563.518976:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787784563.520969:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787784564.340555:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784565.047684:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba300b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643136512:0@lo:400:kworker.0 00000100:00100000:1.0:1787784565.047760:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784565.047803:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643137024:0@lo:400:kworker.0 00000100:00100000:1.0:1787784565.047829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784565.047866:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787784565.047872:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643136640:0@lo:400:kworker.0 00000100:00100000:1.0:1787784565.047893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784565.047910:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643137152:0@lo:400:kworker.0 00000100:00100000:1.0:1787784565.048048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784565.048076:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136896:0@lo:400:kworker.0 00000100:00100000:1.0:1787784565.048099:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784565.048131:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643136768:0@lo:400:kworker.0 00000100:00100000:3.0:1787784565.048158:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784565.049573:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136512 00000100:00100000:2.0:1787784565.049594:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136512 00000100:00100000:2.0:1787784565.049645:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787784565.049654:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643136512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784565.049741:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643136512:12345-0@lo:400:kworker.0 Request processed in 89us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784565.049748:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787784565.050776:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137152 00000100:00100000:3.0:1787784565.050783:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137152 00000100:00100000:3.0:1787784565.050824:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136896 00000100:00100000:3.0:1787784565.050827:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136896 00000100:00100000:3.0:1787784565.050860:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787784565.050869:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643137152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784565.050917:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643137152:12345-0@lo:400:kworker.0 Request processed in 51us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784565.050924:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787784565.051734:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787784565.051742:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784565.051796:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643136896:12345-0@lo:400:kworker.0 Request processed in 56us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784565.051803:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787784565.051885:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137024 00000100:00100000:0.0:1787784565.051892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137024 00000100:00100000:0.0:1787784565.051942:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136640 00000100:00100000:0.0:1787784565.051946:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136640 00000100:00100000:0.0:1787784565.051965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643136768 00000100:00100000:0.0:1787784565.051968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643136768 00000100:00100000:0.0:1787784565.051986:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787784565.051993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643137024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.052034:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643137024:12345-0@lo:400:kworker.0 Request processed in 42us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784565.052041:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787784565.052056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787784565.052062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643136640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.052090:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643136640:12345-0@lo:400:kworker.0 Request processed in 29us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784565.052096:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787784565.052108:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787784565.052114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643136768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.052145:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643136768:12345-0@lo:400:kworker.0 Request processed in 32us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784565.052158:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787784565.054310:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643136640:0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.054330:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643137152:0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.054341:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba300b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643136512:0@lo:400:kworker.0 00000100:00100000:0.0:1787784565.054352:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643137024:0@lo:400:kworker.0 00000100:00080000:0.0:1787784565.056438:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784565.056450:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787784565.056453:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784565.057177:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643136896:0@lo:400:kworker.0 00000100:00100000:3.0:1787784565.058084:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643136768:0@lo:400:kworker.0 00010000:00010000:1.0:1787784565.366797:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784565.557648:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787784565.565782:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784565.565855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784565.566060:0:11854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137280 00000100:00100000:3.0:1787784565.566069:0:11854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137280 00000100:00100000:3.0:1787784565.566132:0:11854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787784565.566141:0:11854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784565.566181:0:11854:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784565.566238:0:11854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784565.566246:0:11854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787784565.567415:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787784566.388639:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784566.520945:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784566.521010:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784566.521110:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784566.521154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784566.521215:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634762880 00000100:00100000:3.0:1787784566.521226:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634762880 00000100:00100000:3.0:1787784566.521283:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 313 00000100:00100000:3.0:1787784566.521293:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634762880:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784566.521399:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2362:x1874627634762880:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784566.521419:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 313 00000100:00100000:0.0:1787784566.522348:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763008 00000100:00100000:0.0:1787784566.522357:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763008 00000100:00100000:0.0:1787784566.522444:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:0.0:1787784566.522456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2362:x1874627634763008:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784566.522510:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431971170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:2362:x1874627634763008:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 59us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784566.522516:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00080000:0.0:1787784566.522551:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784566.526838:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784566.526993:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763392 00000100:00100000:0.0:1787784566.527004:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763392 00000100:00100000:0.0:1787784566.527085:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00100000:0.0:1787784566.527095:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2362:x1874627634763392:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784566.527192:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2362:x1874627634763392:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784566.527200:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00080000:2.0:1787784566.530513:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784566.533252:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763264 00000100:00100000:1.0:1787784566.533268:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763264 00000100:00080000:2.0:1787784566.533429:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784566.533724:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763136 00000100:00100000:1.0:1787784566.533728:0:12520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763136 00000100:00080000:2.0:1787784566.533788:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784566.538442:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:3.0:1787784566.538476:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634763264:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784566.538599:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2362:x1874627634763264:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 142us (17588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784566.538625:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:3.0:1787784566.538648:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:3.0:1787784566.538687:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634763136:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784566.538930:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2362:x1874627634763136:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 273us (17773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784566.538937:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00010000:00010000:1.0:1787784567.412687:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784568.058331:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784568.058830:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763648 00000100:00100000:1.0:1787784568.058841:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763648 00000100:00100000:1.0:1787784568.058919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:1.0:1787784568.058931:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba2583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+18:12360:x1874627634763648:12345-192.168.202.59@tcp:35:umount.0 00000100:00080000:2.0:1787784568.059772:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784568.060752:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba2583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:12360:x1874627634763648:12345-192.168.202.59@tcp:35:umount.0 Request processed in 1815us (2427us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787784568.060763:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1787784568.073898:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784568.074185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634763904 00000100:00100000:0.0:1787784568.074196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634763904 00000100:00100000:0.0:1787784568.074255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:0.0:1787784568.074265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+19:12360:x1874627634763904:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:0.0:1787784568.075028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:12360:x1874627634763904:12345-192.168.202.59@tcp:35:umount.0 Request processed in 760us (1139us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787784568.075038:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:0.0:1787784568.087991:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784568.088877:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764160 00000100:00100000:1.0:1787784568.088890:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764160 00000100:00100000:1.0:1787784568.088964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:1.0:1787784568.088975:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ac73e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:12360:x1874627634764160:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:1.0:1787784568.089469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ac73e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:12360:x1874627634764160:12345-192.168.202.59@tcp:35:umount.0 Request processed in 493us (1486us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787784568.089478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:2.0:1787784568.094359:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784568.094674:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764416 00000100:00100000:1.0:1787784568.094685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764416 00000100:00100000:1.0:1787784568.094750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1787784568.094761:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+21:12360:x1874627634764416:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:1.0:1787784568.095480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:12360:x1874627634764416:12345-192.168.202.59@tcp:35:umount.0 Request processed in 717us (1130us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787784568.095490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:0.0:1787784568.102134:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784568.102230:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784568.105056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784568.105383:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784568.106005:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764672 00000100:00100000:2.0:1787784568.106018:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764672 00000100:00100000:2.0:1787784568.106127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764544 00000100:00100000:2.0:1787784568.106131:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764544 00000100:00100000:1.0:1787784568.106218:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764800 00000100:00100000:1.0:1787784568.106223:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764800 00000100:00100000:3.0:1787784568.106352:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1787784568.106386:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+15:2364:x1874627634764672:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784568.106401:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784568.106423:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181513200/0xffb8d925c20ba957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a871 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784568.106441:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784568.106495:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+14:2364:x1874627634764672:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 134us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784568.106564:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784568.106576:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+14:2364:x1874627634764544:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784568.106584:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784568.106595:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0400/0xffb8d925c20ba9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8a9 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784568.106620:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784568.106639:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+13:2364:x1874627634764544:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 69us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784568.107224:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784568.107253:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1787784568.107262:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2364:x1874627634764800:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784568.107344:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784568.107359:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1600/0xffb8d925c20babdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a974 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784568.107421:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784568.107446:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+11:2364:x1874627634764800:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 187us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784568.107453:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1787784568.108158:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634764928 00000100:00100000:1.0:1787784568.108167:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634764928 00000100:00100000:1.0:1787784568.108221:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:1.0:1787784568.108229:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2361:x1874627634764928:12345-192.168.202.59@tcp:9:umount.0 00000020:00000080:1.0:1787784568.108259:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20bacc9 00000100:00080000:1.0:1787784568.108269:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9431bf3ad000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787784568.108417:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00080000:3.0:1787784568.108485:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1787784568.108582:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787784568.109129:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+2:2361:x1874627634764928:12345-192.168.202.59@tcp:9:umount.0 Request processed in 899us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784568.109139:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00010000:00010000:3.0:1787784568.109584:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784568.115694:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784568.115951:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634765312 00000100:00100000:0.0:1787784568.115961:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634765312 00000100:00100000:0.0:1787784568.116029:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1787784568.116040:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+7:2361:x1874627634765312:12345-192.168.202.59@tcp:9:umount.0 00000020:00000080:0.0:1787784568.116076:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20baf31 00000020:00010000:0.0:1787784568.116084:0:6677:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bee31800: total 0 00000100:00080000:0.0:1787784568.116089:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9431bee32000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784568.116130:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787784568.116483:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+5:2361:x1874627634765312:12345-192.168.202.59@tcp:9:umount.0 Request processed in 444us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784568.116491:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00080000:3.0:1787784568.117034:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1787784568.117292:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bee31800: total 0 00010000:00010000:2.0:1787784568.117345:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bee31800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787784568.117446:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4c6237/0xffb8d925c20bb96b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad17 expref: 4 pid: 12520 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784568.117483:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000548e01a9/0xffb8d925c20bb2cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab49 expref: 3 pid: 8198 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784568.117499:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bee31800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787784568.117511:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784568.117512:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784568.117514:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784568.144265:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784568.144362:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634766336 00000100:00100000:3.0:1787784568.144414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634766336 00000100:00100000:3.0:1787784568.144470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 240 00000100:00100000:3.0:1787784568.144480:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+22:2361:x1874627634766336:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:3.0:1787784568.144518:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba965 00000020:00010000:3.0:1787784568.144548:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431b9885000: total 0 00000100:00080000:3.0:1787784568.144554:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9431b9881000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787784568.144588:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1787784568.144829:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431b9885000: total 0 00010000:00010000:1.0:1787784568.144834:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784568.144877:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431b9885000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787784568.144923:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943183923100) 00010000:00010000:1.0:1787784568.144926:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784568.144936:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bac2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a982 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.144971:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784568.144975:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:3.0:1787784568.144977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9a4fd2c-0c67-4cd1-a267-69f5c190cff9+20:2361:x1874627634766336:12345-192.168.202.59@tcp:39:umount.0 Request processed in 498us (722us total) trans 4294967525 rc 0/0 00010000:00010000:1.0:1787784568.144979:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501800/0xffb8d925c20bb62a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ac3e expref: 20 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784568.144986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 240 00010000:00010000:1.0:1787784568.144992:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784568.144994:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787784568.145005:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610e00/0xffb8d925c20baf8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aa70 expref: 18 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145019:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:1.0:1787784568.145022:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784568.145025:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89a00/0xffb8d925c20bb34b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab6c expref: 17 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145040:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784568.145042:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784568.145046:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501a00/0xffb8d925c20bb1ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aafc expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145058:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff94318a498800) 00010000:00010000:1.0:1787784568.145060:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787784568.145063:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bac9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a99e expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145077:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784568.145080:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787784568.145084:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500000/0xffb8d925c20bb84c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849acca expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145101:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:1.0:1787784568.145103:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784568.145107:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bb32f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab65 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145118:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943183923c00) 00010000:00010000:1.0:1787784568.145125:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784568.145130:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501400/0xffb8d925c20bac4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a989 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145145:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784568.145148:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784568.145151:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0800/0xffb8d925c20bb2b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab42 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145162:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784568.145165:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784568.145167:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bb92c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad02 expref: 10 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145178:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff943183fdc500) 00010000:00010000:1.0:1787784568.145180:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787784568.145184:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943185610a00/0xffb8d925c20bb956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad10 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145205:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff943183923900) 00010000:00010000:1.0:1787784568.145207:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787784568.145210:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88200/0xffb8d925c20bb28e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ab34 expref: 8 pid: 8618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784568.145224:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431b9885000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787784568.145236:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784568.145238:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784568.145240:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784568.436699:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784568.629045:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784568.629141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784568.631790:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137408 00000100:00100000:3.0:1787784568.631807:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137408 00000100:00100000:3.0:1787784568.631972:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787784568.631987:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba2592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784568.632032:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784568.632144:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba2592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784568.632152:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787784568.632286:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787784568.632737:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787784569.140904:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787784569.140919:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787784569.141326:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787784569.141334:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787784569.462161:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784570.166154:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643137792:0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.166226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784570.166230:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137920:0@lo:400:kworker.0 00000100:00100000:1.0:1787784570.166274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784570.166297:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643137664:0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.166323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784570.166477:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643137536:0@lo:400:kworker.0 00000100:00100000:1.0:1787784570.169634:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137792 00000100:00100000:1.0:1787784570.169649:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137792 00000100:00100000:1.0:1787784570.169719:0:8617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137664 00000100:00100000:1.0:1787784570.169723:0:8617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137664 00000100:00100000:1.0:1787784570.169751:0:8617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787784570.169761:0:8617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643137792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.169891:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643138176:0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.169946:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784570.170028:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137920 00000100:00100000:2.0:1787784570.170033:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137920 00000100:00100000:2.0:1787784570.170062:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138176 00000100:00100000:2.0:1787784570.170065:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138176 00000100:00100000:2.0:1787784570.170085:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784570.170092:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.170148:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643137920:12345-0@lo:400:kworker.0 Request processed in 56us (3873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.170155:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787784570.170171:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784570.170177:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643138176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.170209:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643138176:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.170215:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787784570.170250:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643138176:0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.170292:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787784570.170300:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643137664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.170335:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643137664:12345-0@lo:400:kworker.0 Request processed in 37us (4011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.170341:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1787784570.170358:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784570.170362:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787784570.170383:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784570.170405:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643137664:0@lo:400:kworker.0 00000100:00100000:3.0:1787784570.174025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784570.174107:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643138048:0@lo:400:kworker.0 00000100:00100000:3.0:1787784570.174175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784570.174214:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138048 00000100:00100000:3.0:1787784570.174222:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138048 00000100:00100000:3.0:1787784570.175507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787784570.175522:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643138048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.175641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643137536 00000100:00100000:2.0:1787784570.175647:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643137536 00000100:00100000:2.0:1787784570.175682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787784570.175688:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643137536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784570.175832:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643137920:0@lo:400:kworker.0 00000100:00080000:0.0:1787784570.175868:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784570.181922:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643138048:12345-0@lo:400:kworker.0 Request processed in 6394us (7736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784570.182343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787784570.182532:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643138048:0@lo:400:kworker.0 00000100:00100000:1.0:1787784570.183041:0:8617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643137792:12345-0@lo:400:kworker.0 Request processed in 13279us (16812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784570.183050:0:8617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787784570.187643:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643137792:0@lo:400:kworker.0 00000100:00100000:2.0:1787784570.194996:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643137536:12345-0@lo:400:kworker.0 Request processed in 19298us (20970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.195013:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787784570.195166:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643137536:0@lo:400:kworker.0 00000100:00100000:0.0:1787784570.469713:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784570.469755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784570.469799:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784570.469918:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634766592 00000100:00100000:2.0:1787784570.469929:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634766592 00000100:00100000:2.0:1787784570.470011:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634766464 00000100:00100000:2.0:1787784570.470015:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634766464 00000100:00100000:2.0:1787784570.470029:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634766720 00000100:00100000:2.0:1787784570.470032:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634766720 00000100:00100000:2.0:1787784570.470054:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784570.470067:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1787784570.470068:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2363:x1874627634766592:12345-192.168.202.59@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787784570.470086:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+12:2363:x1874627634766464:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784570.470088:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784570.470100:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784570.470112:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0c00/0xffb8d925c20baa3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784570.470116:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030a00/0xffb8d925c20baa37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8be expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784570.470140:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784570.470140:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784570.470273:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+10:2363:x1874627634766464:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 194us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784570.470282:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784570.470301:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:3.0:1787784570.470308:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+9:2363:x1874627634766720:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784570.470317:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784570.470327:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1200/0xffb8d925c20babd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a96d expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784570.470336:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784570.472293:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db7e8534-d8e1-4743-9795-d099e9d1ca8f+8:2363:x1874627634766592:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 2220us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.472308:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784570.473961:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db7e8534-d8e1-4743-9795-d099e9d1ca8f+7:2363:x1874627634766720:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 3644us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784570.473974:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:2.0:1787784570.484600:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784570.485937:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784570.486019:0:8618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634766976 00000100:00100000:2.0:1787784570.486028:0:8618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634766976 00000100:00100000:2.0:1787784570.486114:0:8618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 241 00000100:00100000:2.0:1787784570.486123:0:8618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+6:2361:x1874627634766976:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:2.0:1787784570.486161:0:8618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20baa4c 00000020:00010000:2.0:1787784570.486169:0:8618:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431862be000: total 0 00000100:00080000:2.0:1787784570.486181:0:8618:0:(import.c:65:import_set_state_nolock()) ffff9431862b8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787784570.486208:0:8618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787784570.486459:0:8618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2dcd91ed-fe78-44b1-8596-d4df1b711f35+5:2361:x1874627634766976:12345-192.168.202.59@tcp:39:umount.0 Request processed in 337us (529us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787784570.486466:0:8618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 241 00000020:00010000:2.0:1787784570.486520:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431862be000: total 0 00010000:00010000:2.0:1787784570.486558:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431862be000, canceled 0 locks, left on hash table 1. 00000100:00080000:0.0:1787784570.486766:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784570.487064:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdcf00) 00010000:00010000:2.0:1787784570.487069:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784570.487078:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bb979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad1e expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784570.487102:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431862be000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787784570.487115:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784570.487117:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784570.487119:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784570.545121:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784570.545391:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767232 00000100:00100000:3.0:1787784570.545402:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767232 00000100:00100000:3.0:1787784570.545466:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 315 00000100:00100000:3.0:1787784570.545476:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+7:2361:x1874627634767232:12345-192.168.202.59@tcp:251:umount.0 00000020:00000080:3.0:1787784570.545527:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba942 00000020:00010000:3.0:1787784570.545535:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9431bf6e9000: total 0 00000100:00080000:3.0:1787784570.545540:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e9800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787784570.545785:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9431bf6e9000: total 0 00010000:00010000:2.0:1787784570.545790:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784570.545833:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9431bf6e9000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787784570.545868:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f1400/0xffb8d925c20ba9f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849a8b0 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784570.545885:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9431bf6e9000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787784570.545895:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784570.545897:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784570.545899:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784570.545945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943185683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db7e8534-d8e1-4743-9795-d099e9d1ca8f+1:2361:x1874627634767232:12345-192.168.202.59@tcp:251:umount.0 Request processed in 470us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784570.545953:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 315 00000020:00000080:3.0:1787784570.545964:0:5826:0:(genops.c:885:class_export_put()) final put ffff9431bf6e9000/db7e8534-d8e1-4743-9795-d099e9d1ca8f 00000020:00000080:2.0:1787784570.546781:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf6e9000/db7e8534-d8e1-4743-9795-d099e9d1ca8f for MGS 00000020:00000080:2.0:1787784570.546832:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf6e9800 for MGS 00000100:00100000:3.0:1787784570.679235:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643138304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784570.679311:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784570.679526:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138304 00000100:00100000:2.0:1787784570.679533:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138304 00000100:00100000:2.0:1787784570.679598:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787784570.679609:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643138304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784570.679656:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784570.679720:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643138304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784570.679741:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787784570.680052:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643138304:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787784571.286770:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:2.0:1787784571.286790:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1787784571.286801:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000001:00080000:2.0:1787784571.286807:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787784571.286810:0:5853:0:(genops.c:885:class_export_put()) final put ffff9431862be000/2dcd91ed-fe78-44b1-8596-d4df1b711f35 00000001:00100000:2.0:1787784571.286830:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000001:00080000:2.0:1787784571.286838:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787784571.286840:0:5853:0:(genops.c:885:class_export_put()) final put ffff9431b9885000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:2.0:1787784571.286854:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431862be000/2dcd91ed-fe78-44b1-8596-d4df1b711f35 for lustre-MDT0000 00000020:00000080:2.0:1787784571.286911:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9885000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-MDT0000 00000020:00000080:2.0:1787784571.286938:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431862b8800 for lustre-MDT0000 00000020:00000080:2.0:1787784571.286943:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b9881000 for lustre-MDT0000 00000001:00100000:1.0:1787784571.295818:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:1.0:1787784571.295828:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431bee31800/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:2.0:1787784571.295921:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bee31800/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-OST0000 00000020:00000080:2.0:1787784571.295988:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bee32000 for lustre-OST0000 00010000:00010000:2.0:1787784571.511827:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784572.534656:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787784572.567716:0:13009:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787784572.594659:0:13009:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787784572.594717:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.594732:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.594739:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.594747:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.594781:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787784572.594787:0:13009:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787784572.595963:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784572.595975:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784572.595986:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943180030000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784572.595990:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784572.596000:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784572.596008:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784572.596025:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784572.596027:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787784572.596030:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787784572.596071:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784572.596077:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784572.596111:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784572.596118:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180030000/0xffb8d925c20ba9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9ce expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784572.596134:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784572.596136:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784572.596138:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784572.596425:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784572.596449:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643138432:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787784572.596476:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784572.596482:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787784572.596523:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784572.596526:0:13009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787784572.596543:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787784572.598743:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643138560:0@lo:39:umount.0 00000100:00100000:1.0:1787784572.598746:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138432 00000100:00100000:1.0:1787784572.598757:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138432 00000100:00100000:0.0:1787784572.598818:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784572.598891:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138560 00000100:00100000:0.0:1787784572.598896:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138560 00000100:00100000:0.0:1787784572.598943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787784572.598953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874627643138560:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787784572.598983:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba751 00000100:00080000:0.0:1787784572.598992:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9431868fe000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787784572.599056:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3292:x1874627643138560:12345-0@lo:39:umount.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784572.599062:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787784572.599069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787784572.599073:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3293:x1874627643138432:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787784572.599086:0:5833:0:(genops.c:885:class_export_put()) final put ffff9431868fb000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787784572.599087:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784572.599108:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611800/0xffb8d925c20ba9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba9c7 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.599120:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784572.599124:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1787784572.599149:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b5c4b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787784572.599165:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643138560:0@lo:39:umount.0 00000100:00100000:1.0:1787784572.599168:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3293:x1874627643138432:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784572.599178:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:0.0:1787784572.599195:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431868fb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1787784572.599219:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643138432:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787784572.599243:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784572.599246:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000020:00000080:0.0:1787784572.599247:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431868fe000 for lustre-MDT0000 00000100:00100000:1.0:1787784572.599251:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787784572.601403:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601422:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601446:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601454:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601481:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784572.601488:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601496:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601502:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601508:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601533:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784572.601541:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601547:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601553:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.601570:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.604479:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787784572.604502:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.604515:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.604522:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.604528:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784572.604542:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787784572.604546:0:13009:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787784572.604596:0:13009:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787784572.604608:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787784572.604613:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784572.604620:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787784572.604627:0:13009:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9431bed60800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787784572.604633:0:13009:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9431ac7a3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787784572.604638:0:13009:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9431857e0000) has exports, disconnecting them 00000020:00080000:1.0:1787784572.604642:0:13009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9431bed60800), last request at 1787784570 00000020:00000080:1.0:1787784572.604650:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba8c4 00000100:00080000:1.0:1787784572.604671:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9431bed63800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787784572.604738:0:13009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bed60800): rc 0 00000020:00000080:1.0:1787784572.604741:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431bed60800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1787784572.604976:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787784572.604985:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.604993:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784572.604997:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605005:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784572.605013:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784572.605019:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784572.605022:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787784572.605033:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787784572.605072:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605079:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784572.605105:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605114:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20ba9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9dc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605127:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787784572.605131:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605136:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431c2045200 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784572.605139:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605145:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784572.605152:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784572.605157:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784572.605160:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787784572.605162:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787784572.605175:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605180:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784572.605193:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605199:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431c2045200/0xffb8d925c20ba8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba903 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605213:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784572.605216:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605222:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784572.605224:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605230:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784572.605235:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784572.605239:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787784572.605241:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787784572.605243:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787784572.605256:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605261:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784572.605276:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605282:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1800/0xffb8d925c20babfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20bac05 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605300:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784572.605303:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605308:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784572.605311:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605317:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784572.605323:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784572.605328:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787784572.605330:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787784572.605331:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787784572.605345:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605351:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784572.605357:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605378:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513c00/0xffb8d925c20ba6b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba6b7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.605390:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784572.605392:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784572.605399:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784572.605417:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643138688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.605483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784572.605533:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787784572.605539:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643138816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.605563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784572.605620:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643138944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.605662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784572.605682:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787784572.605688:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643139072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.605707:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784572.605738:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138688 00000100:00100000:3.0:1787784572.605744:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138688 00000100:00100000:3.0:1787784572.605780:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138816 00000100:00100000:3.0:1787784572.605783:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138816 00000100:00100000:3.0:1787784572.605793:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643138944 00000100:00100000:3.0:1787784572.605795:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643138944 00000100:00100000:3.0:1787784572.605804:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643139072 00000100:00100000:3.0:1787784572.605806:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643139072 00000100:00100000:3.0:1787784572.605818:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784572.605826:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+21:3295:x1874627643138688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784572.605837:0:8443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1787784572.609866:0:13009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9431ac7a3000), last request at 1787784570 00000020:00000080:1.0:1787784572.609880:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba7f9 00000100:00080000:1.0:1787784572.609895:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9431ac7a7000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787784572.609936:0:13009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431ac7a3000): rc 0 00000020:00000080:1.0:1787784572.609939:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431ac7a3000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787784572.610008:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031a00/0xffb8d925c20ba9dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba9d5 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.610029:0:8443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784572.610058:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784572.610083:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784572.610100:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943186561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+20:3295:x1874627643138816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784572.610132:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784572.610146:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180030600/0xffb8d925c20ba903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba8fc expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.610159:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784572.610237:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943186561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+19:3295:x1874627643138816:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784572.610246:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787784572.610273:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784572.610280:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+18:3293:x1874627643138944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784572.610291:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784572.610301:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88800/0xffb8d925c20bac05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20babfe expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.610310:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784572.610341:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d25e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+17:3293:x1874627643138944:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784572.610348:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787784572.610360:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784572.610385:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+16:3293:x1874627643139072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784572.610394:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784572.610403:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431c2044000/0xffb8d925c20ba6b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba6b0 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784572.610415:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784572.610437:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+15:3293:x1874627643139072:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (4729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784572.610453:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787784572.610521:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643139072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.610532:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643138944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.610570:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643138816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784572.610691:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5+14:3295:x1874627643138688:12345-0@lo:103:ldlm_bl.0 Request processed in 4865us (5208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784572.610698:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787784572.610739:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643138688:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787784572.610959:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bed60800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787784572.611017:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bed63800 for lustre-MDT0000 00010000:00010000:2.0:1787784572.611227:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784572.611231:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1787784572.611565:0:13009:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb46dc2c47ae0 00000100:00080000:1.0:1787784572.611599:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787784572.611633:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787784572.611654:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787784572.611721:0:13009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787784572.611743:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9431b42bf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787784572.611769:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787784572.611771:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787784572.611779:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787784572.611843:0:13009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787784572.611852:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9431862bf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787784572.611879:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9431857e0000) has no exports 00000100:00100000:2.0:1787784572.612310:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643139200:0@lo:9:umount.0 00000100:00100000:2.0:1787784572.612399:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784572.612430:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643139328:0@lo:9:umount.0 00000100:00100000:2.0:1787784572.612454:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784572.612539:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643139200 00000100:00100000:0.0:1787784572.612545:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643139200 00000100:00100000:0.0:1787784572.612619:0:8198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643139328 00000100:00100000:0.0:1787784572.612624:0:8198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643139328 00000100:00100000:0.0:1787784572.612648:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784572.612658:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874627643139200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787784572.612680:0:8198:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba854 00000100:00080000:0.0:1787784572.612688:0:8198:0:(import.c:65:import_set_state_nolock()) ffff9431bed67800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784572.612719:0:8198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787784572.613035:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3292:x1874627643139200:12345-0@lo:9:umount.0 Request processed in 379us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784572.613056:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787784572.613072:0:8198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787784572.613078:0:8198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1874627643139328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787784572.613089:0:8198:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba92d 00000100:00080000:0.0:1787784572.613095:0:8198:0:(import.c:65:import_set_state_nolock()) ffff9431b9dac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787784572.613112:0:8198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787784572.613198:0:8198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3292:x1874627643139328:12345-0@lo:9:umount.0 Request processed in 120us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784572.613205:0:8198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787784572.613247:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42bf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784572.613257:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784572.613259:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784572.613263:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643139200:0@lo:9:umount.0 00000100:00080000:0.0:1787784572.613274:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431862bf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787784572.613280:0:3292:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787784572.613281:0:3292:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784572.613283:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643139328:0@lo:9:umount.0 00010000:00010000:0.0:1787784572.613309:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784572.613320:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784572.614122:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784572.614128:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787784572.614296:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431ac7a3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787784572.614339:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431ac7a7000 for lustre-MDT0000 00000020:00080000:1.0:1787784572.621127:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9431857e0000) has no exports 00000020:00000080:1.0:1787784572.674567:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba70b 00000020:00000080:1.0:1787784572.674586:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b42bc000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787784572.674658:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787784572.674903:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787784572.674931:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784572.674942:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787784572.674947:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9431b5c40000) has no exports 00000020:00000080:0.0:1787784572.676037:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba704 00000020:00000080:0.0:1787784572.676048:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b5c4a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787784572.676220:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c4a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784572.676276:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784572.676286:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787784572.676290:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b4b89000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787784572.676306:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b4b89000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787784572.676311:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1787784572.676715:0:13009:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff943186eac7e0 - data ffff94308146a360/ffff9431bf6fc000 00000020:01000000:0.0:1787784572.677048:0:13009:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9431885c1900 - data ffff9431ad032438/ffff9431b4b90000 00000001:00000004:0.0:1787784572.688548:0:13009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787784572.798505:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787784572.798514:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787784572.798536:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787784572.798539:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787784572.801947:0:6986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787784572.801966:0:6986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1787784572.801980:0:6986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787784572.804480:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784572.804488:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787784572.804508:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784572.804511:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787784572.807716:0:7914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787784572.807725:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787784572.807812:0:7914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:2.0:1787784572.808478:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787784572.808485:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431b9daf800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787784572.808511:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:2.0:1787784572.808514:0:7631:0:(genops.c:885:class_export_put()) final put ffff9431bf3af000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 00000020:00000080:0.0:1787784572.808581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9daf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787784572.808633:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf3af000/f9a4fd2c-0c67-4cd1-a267-69f5c190cff9 for lustre-OST0001 00000020:00000080:0.0:1787784572.808650:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b9dac000 for lustre-OST0001 00000020:00000080:0.0:1787784572.808655:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf3ad000 for lustre-OST0001 00000020:00000080:2.0:1787784572.871701:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba6d3 00000020:00000080:2.0:1787784572.871715:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b29a3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787784572.872938:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba6e8 00000020:00000080:2.0:1787784572.872951:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b4b8d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784572.872959:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787784572.872965:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784572.872975:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784572.872979:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9431857e4d28) has no exports 00000004:01000000:2.0:1787784572.873158:0:13009:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787784572.873169:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba926 00000020:00000080:2.0:1787784572.873173:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431862be800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784572.873178:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787784572.873181:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784572.873188:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787784572.873190:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9431885e0000) has no exports 00000020:00000080:2.0:1787784572.873197:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba91f 00000020:00000080:2.0:1787784572.873200:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431862bb000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787784572.873632:0:13009:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787784572.873638:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787784572.873643:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787784572.873649:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784572.873652:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784572.873701:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784572.873710:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784572.873716:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba83f 00000020:00000080:2.0:1787784572.873721:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431bed60000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787784572.873726:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787784572.873729:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784572.873733:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787784572.873735:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9431908f8000) has no exports 00000020:00000080:2.0:1787784572.873740:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba838 00000020:00000080:2.0:1787784572.873743:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b42b8800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787784572.874056:0:13009:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787784572.874060:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787784572.874062:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787784572.874065:0:13009:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787784572.874067:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784572.874096:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784572.874101:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784572.874124:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784572.874126:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787784572.874154:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba6ef 00000020:00000080:2.0:1787784572.874159:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b4b8f000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787784572.874163:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787784572.874167:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784572.874170:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787784572.874172:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9431857e19b8) has no exports 00000020:00000080:2.0:1787784572.874194:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784572.874198:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787784572.874201:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba6f6 00000020:00000080:2.0:1787784572.874204:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b4b8b000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787784572.874212:0:13009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94318875c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787784572.874216:0:13009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94318875c800 3 00000020:01000004:2.0:1787784572.874220:0:13009:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94318875c800 from lustre-MDT0000 00000020:00000080:2.0:1787784572.874239:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787784572.874248:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787784572.874252:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b29a0800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787784572.874254:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b29a0800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787784572.874263:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787784572.874329:0:13009:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787784572.874332:0:13009:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787784572.874335:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787784572.874338:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787784572.874341:0:13009:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787784572.874348:0:13009:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94318576f800 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787784572.874353:0:13009:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9431885e4d28) has exports, disconnecting them 00000020:00080000:2.0:1787784572.874358:0:13009:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94318576f800), last request at 1787784316 00000020:00000080:2.0:1787784572.874397:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba694 00000020:00010000:2.0:1787784572.874401:0:13009:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94318576f800: total 8 00000100:00080000:2.0:1787784572.874405:0:13009:0:(import.c:65:import_set_state_nolock()) ffff94318576a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787784572.874424:0:13009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94318576f800): rc 0 00000020:00080000:2.0:1787784572.874428:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9431885e4d28) has no exports 00000020:00010000:0.0:1787784572.874471:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94318576f800: total 8 00000100:00100000:2.0:1787784572.874490:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff943185674c00:5825] 1 exiting: rc = 0 00010000:00010000:0.0:1787784572.874511:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94318576f800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787784572.874544:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181513400/0xffb8d925c20ba9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba9ab expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874572:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf7f0000/0xffb8d925c20ba9a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba99d expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874585:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943180031400/0xffb8d925c20ba9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba9b9 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874598:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1600/0xffb8d925c20babf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20babf0 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874618:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943181512800/0xffb8d925c20ba7ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba7a5 expref: 5 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874646:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185611600/0xffb8d925c20ba9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba9e3 expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874656:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1000/0xffb8d925c20babe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20babe2 expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874667:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d0400/0xffb8d925c20ba996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xffb8d925c20ba98f expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784572.874678:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94318576f800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787784572.874693:0:5819:0:(genops.c:885:class_export_put()) final put ffff94318576f800/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 00010000:00010000:0.0:1787784572.874699:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784572.874701:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784572.874703:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784572.874729:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff943185675a00:5823] 0 exiting: rc = 1 00000020:00000080:3.0:1787784572.874853:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b29a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784572.874866:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b4b8d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787784572.874871:0:475:0:(genops.c:885:class_export_put()) final put ffff9431b29a4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784572.874873:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b29a4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787784572.874877:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784572.875009:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431862be800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787784572.875016:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431862bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784572.875020:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431862bf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787784572.875024:0:475:0:(genops.c:885:class_export_put()) final put ffff9431b9550000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784572.875026:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9550000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787784572.875030:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784572.875058:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bed60000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787784572.875063:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42b8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784572.875075:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b42bf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787784572.875080:0:475:0:(genops.c:885:class_export_put()) final put ffff9431bf183800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784572.875081:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf183800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787784572.875085:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787784572.875152:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b4b8f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787784572.875156:0:475:0:(genops.c:885:class_export_put()) final put ffff9431b4b8a000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787784572.875158:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b4b8a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787784572.875165:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787784572.875319:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b4b8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784572.875323:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff94318576f800/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 for MGS 00000020:00000080:3.0:1787784572.875359:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94318576a800 for MGS 00000100:00100000:3.0:1787784572.875408:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff94318575b600:5826] 2 exiting: rc = 0 00000100:00100000:2.0:1787784572.876075:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876084:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876090:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876095:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876101:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876107:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876112:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876117:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876123:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876128:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876134:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876139:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876146:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876151:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876156:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876173:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876178:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876184:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876190:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876197:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876203:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876210:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876216:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876222:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876227:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876233:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876238:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876246:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876251:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876257:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876263:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876270:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876275:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876280:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876286:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876293:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876298:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876303:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876308:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876314:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876320:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876326:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876331:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876337:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876343:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876348:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876353:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876358:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876515:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876524:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876538:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876543:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876547:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876552:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876558:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876563:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876568:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876573:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876578:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876583:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876588:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876594:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876608:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.876614:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787784572.877059:0:13009:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787784572.877063:0:13009:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787784572.886939:0:13009:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9431860786c0 - data ffff9431ad32fe58/ffff9431bf753000 00000020:01000000:0.0:1787784572.887231:0:13009:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94318909b480 - data ffff9431ad01c360/ffff9431856ef000 00000020:00000080:0.0:1787784572.889643:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba678 00000020:00000080:0.0:1787784572.889656:0:13009:0:(genops.c:885:class_export_put()) final put ffff943186998000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787784572.889734:0:13009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94318875c800 from MGS, refs=2 00000020:01000004:0.0:1787784572.889739:0:13009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94318875c800 2 00000020:01000004:0.0:1787784572.889743:0:13009:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94318875c800 from MGS 00000020:00000080:0.0:1787784572.889775:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784572.889784:0:13009:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787784572.889786:0:13009:0:(genops.c:885:class_export_put()) final put ffff94318699c800/MGS 00000020:00000080:0.0:1787784572.889789:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff94318699c800/MGS for MGS 00000020:01000000:0.0:1787784572.889796:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787784572.889889:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787784572.889894:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784572.889899:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787784572.889918:0:13009:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9431b5c48800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787784572.889925:0:13009:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9431b5c419b8) has exports, disconnecting them 00000020:00080000:0.0:1787784572.889929:0:13009:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9431b5c48800), last request at 1787784317 00000020:00000080:0.0:1787784572.889934:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba743 00000020:00080000:0.0:1787784572.889947:0:13009:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431b5c48800): rc 0 00000020:00000080:0.0:1787784572.889952:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b5c48800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787784572.891609:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff943186998000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787784572.892352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c48800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787784572.893616:0:13009:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787784572.893627:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784572.893631:0:13009:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787784572.893637:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784572.893732:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431b5c4b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787784572.893850:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784572.893859:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787784572.893864:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431b5c4e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787784572.893867:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b5c4e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787784572.893877:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787784572.893935:0:13009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94318875c800 1 00000020:00000080:3.0:1787784572.894052:0:13009:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba66a 00000020:00000080:3.0:1787784572.894060:0:13009:0:(genops.c:885:class_export_put()) final put ffff94318699e800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787784572.894072:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787784572.894077:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784572.894092:0:13009:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784572.894096:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9431885e3370) has no exports 00000020:00000080:0.0:1787784572.894180:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff94318699e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787784572.958407:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784572.958424:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787784572.958432:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431830df800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787784572.958437:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff9431830df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787784572.958446:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787784572.958630:0:13009:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9431830d9800 00000020:01000000:0.0:1787784572.958656:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787784572.958660:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784572.958665:0:13009:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787784572.958670:0:13009:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9431857e3370) has no exports 00000100:00100000:0.0:1787784572.958789:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9431850e4600:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1787784572.958950:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff943186fed200:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1787784572.960623:0:8617:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9431bf6f7000:8617] 3 exiting: rc = 0 00000100:00100000:2.0:1787784572.960627:0:8618:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9431bf75b400:8618] 4 exiting: rc = 0 00000100:00100000:1.0:1787784572.960814:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff94318572a600:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1787784572.962505:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962521:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962527:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962533:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962539:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962555:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962562:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962567:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962573:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962579:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962584:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962615:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962620:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962626:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962633:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962639:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962645:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962651:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962657:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962662:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962668:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.962673:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963076:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963082:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963089:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963094:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963100:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963105:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963110:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963116:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963228:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963240:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963246:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963253:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963260:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963266:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963271:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963278:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963283:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963289:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963296:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963301:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963306:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963312:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963319:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963325:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963342:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963349:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963356:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963612:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963623:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963631:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963637:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963647:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963657:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963666:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963674:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963682:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963688:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963700:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963713:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963719:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963725:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.963733:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969023:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9431a55b9c00:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1787784572.969300:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff94318572b200:5834] 0 exiting: rc = 1 00000100:00100000:0.0:1787784572.969479:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969488:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969495:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969502:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969508:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969517:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969523:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969530:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969536:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969543:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969549:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969555:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969561:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969566:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969571:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969577:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969665:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969671:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969677:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969682:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969687:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969692:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969699:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969704:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969708:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969713:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969718:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969723:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969728:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969733:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969738:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969743:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969748:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969754:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969759:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969764:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969770:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969775:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969781:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969786:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969791:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969804:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969810:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969816:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969822:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969827:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969833:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969838:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969842:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969847:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969851:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969865:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969871:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969876:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969881:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969886:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969891:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969896:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969902:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969907:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969911:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969916:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969923:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.969939:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.970719:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff943191a2ce00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1787784572.971171:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9431857ace00:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1787784572.971241:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971248:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971255:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971264:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971269:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971275:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971282:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971288:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971295:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971300:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971306:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971315:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971325:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971331:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971337:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971361:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971386:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971396:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971402:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971409:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971414:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971419:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971447:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971453:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971459:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971467:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971473:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971491:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971498:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971503:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971509:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971515:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971521:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971526:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971531:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971537:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971542:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971549:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971555:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971572:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971579:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971585:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971591:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971596:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971614:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971620:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971626:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971632:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971637:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971642:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971648:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971668:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971675:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971682:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971689:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971695:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971701:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971714:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971720:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971726:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971732:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971737:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971745:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.971764:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.983259:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9431857ac600:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1787784572.983409:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff943186895a00:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787784572.983464:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983482:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983488:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983493:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983498:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983503:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983511:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983519:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983526:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983533:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983538:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983543:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983549:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983556:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983561:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983566:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983571:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983576:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983581:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983586:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983591:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983596:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983611:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983616:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983621:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983625:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983630:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983634:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983639:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983643:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983648:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983666:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983671:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983676:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983681:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983686:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983691:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983696:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983701:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983706:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983711:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983716:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983722:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983739:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983744:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983748:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983754:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983759:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983764:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983780:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983787:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983792:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983797:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983803:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983808:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983813:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983818:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983823:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983827:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983831:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983835:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983840:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983845:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.983850:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787784572.985151:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff943186fee600:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1787784572.985472:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff943186feec00:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1787784572.985570:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985576:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985593:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985609:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985616:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985621:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985625:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985630:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985635:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985640:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985645:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985650:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985655:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985659:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985663:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985668:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985672:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985676:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985681:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985686:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985691:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985696:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985703:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985709:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985721:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985738:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985742:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985746:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985750:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985755:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985761:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985767:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985779:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985784:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985790:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985794:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985799:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985810:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985815:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985819:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985824:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985828:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985833:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985838:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985842:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985848:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985854:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985859:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985865:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985870:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985875:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985880:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985885:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985890:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985894:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985899:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985904:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985909:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985914:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985919:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985924:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985929:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985934:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.985939:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.986667:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff943186feea00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1787784572.986769:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff943186fee400:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1787784572.986875:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986882:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986887:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986893:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986898:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986903:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986909:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986914:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986930:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.986936:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987006:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987012:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987017:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987022:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987027:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987032:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987036:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987041:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987047:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987052:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987057:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987061:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987068:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987075:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987084:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987090:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987095:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987101:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987106:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987111:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987116:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987121:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987126:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987130:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987135:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987140:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987145:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987150:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987155:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987160:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987165:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987169:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987174:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987187:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987192:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987197:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987202:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987206:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987211:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987217:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987222:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987228:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987233:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987238:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987244:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987249:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987416:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987423:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987429:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987433:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987439:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987443:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987449:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784572.987454:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.988610:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff943185788800:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787784572.990084:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff943185789e00:5846] 2 exiting: rc = 0 00000100:00100000:2.0:1787784572.990330:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff943185789400:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1787784572.990453:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990462:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990467:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990658:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990667:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990673:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990678:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990684:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990689:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990697:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990703:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990709:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990714:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990722:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990740:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990745:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990752:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990757:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990763:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990770:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990802:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990810:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990815:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990828:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990835:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990840:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990846:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990851:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990857:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990863:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990869:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990875:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990880:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990886:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990892:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990898:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990903:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990909:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990914:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990919:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990924:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990930:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990936:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990942:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990963:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990970:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990977:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990983:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990989:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.990995:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991000:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991006:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991011:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991017:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991022:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991027:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991033:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991038:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991051:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991057:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991063:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991069:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991075:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784572.991081:0:13009:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787784572.998148:0:13009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784572.998162:0:13009:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787784572.998168:0:13009:0:(genops.c:885:class_export_put()) final put ffff9431857dd800/MDS_uuid 00000020:00000080:0.0:1787784572.998173:0:13009:0:(genops.c:844:class_export_destroy()) destroying export ffff9431857dd800/MDS_uuid for MDS 00000020:01000000:0.0:1787784572.998186:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787784572.998596:0:13009:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787784573.558714:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784574.581114:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784575.292192:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643139456:0@lo:400:kworker.0 00000400:00000100:2.0:1787784575.292248:0:3295:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627643139456 offset 0 length 224: 4 00000100:00100000:3.0:1787784575.293167:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643139584:0@lo:400:kworker.0 00000400:00000100:3.0:1787784575.293203:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643139584 offset 0 length 224: 4 00000100:00100000:0.0:1787784575.297309:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643139712:0@lo:400:kworker.0 00000400:00000100:0.0:1787784575.297383:0:3293:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643139712 offset 0 length 224: 4 00010000:00010000:1.0:1787784575.609646:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784575.938524:0:13158:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787784575.951490:0:13158:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787784575.951541:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784575.951556:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784575.951563:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784575.951599:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784575.951623:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787784575.951629:0:13158:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787784575.951651:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787784575.951662:0:13158:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45af480 x1874627643139584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787784575.951681:0:13158:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787784575.951687:0:13158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787784575.951711:0:13158:0:(import.c:65:import_set_state_nolock()) ffff9431bf181000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787784575.951776:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784575.951783:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784575.951791:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784575.951795:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784575.951804:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784575.951811:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784575.951817:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787784575.951820:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787784575.951822:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787784575.951858:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784575.951864:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787784575.951897:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784575.951903:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f1c00/0xffb8d925c20ba9ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xffb8d925c20ba9b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784575.951914:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784575.951922:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784575.951934:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784575.951947:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784575.951963:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643139968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787784575.952025:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784575.952082:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643139968 00000100:00100000:1.0:1787784575.952089:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643139968 00000100:00100000:1.0:1787784575.952127:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787784575.952134:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1874627643139968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787784575.952141:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787784575 with bad export cookie 18426716631578945172 00000100:00100000:0.0:1787784575.953485:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643139840:0@lo:39:umount.0 00000400:00000100:0.0:1787784575.953530:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643139840 offset 0 length 224: 4 00000100:00100000:2.0:1787784575.955449:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643139584:0@lo:400:kworker.0 00000100:00100000:2.0:1787784575.976608:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1874627643139968:12345-0@lo:103:ldlm_bl.0 Request processed in 24463us (24572us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787784575.976625:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787784575.976888:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787784575.976894:0:3293:0:(import.c:65:import_set_state_nolock()) ffff943186999000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787784575.976897:0:3293:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787784575.992354:0:3293:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.159@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787784575.992359:0:3293:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787784575.992932:0:3293:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45acf00 x1874627643139456/t0(0) o400->MGC192.168.202.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787784591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784575.992949:0:3293:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45b70c0 x1874627643139968/t0(0) o103->MGC192.168.202.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787784591 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787784575.992959:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787784575.992961:0:3293:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787784575.992963:0:3293:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787784575.992967:0:3293:0:(import.c:65:import_set_state_nolock()) ffff943186999000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784575.992972:0:3293:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:1.0:1787784575.992982:0:3293:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import ffff943186999000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784575.993211:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3295:1874627643139456:0@lo:400:kworker.0 00000100:00100000:2.0:1787784575.993276:0:3293:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431ba258f00 x1874627643140096/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784575.993328:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3293:1874627643139968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784575.993810:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba258f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643140096:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787784575.993868:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627643140096 offset 0 length 520: 4 00000001:00100000:1.0:1787784576.447054:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787784576.447064:0:6703:0:(genops.c:885:class_export_put()) final put ffff9431bed66000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787784576.447320:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bed66000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787784576.451699:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bed67800 for lustre-OST0000 00010000:00010000:1.0:1787784576.629153:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784577.653051:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784578.680041:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784579.702182:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784580.404779:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787784580.404790:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787784580.404902:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643140224:0@lo:400:kworker.0 00000400:00000100:3.0:1787784580.404984:0:3295:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643140224 offset 0 length 224: 4 00010000:00010000:1.0:1787784580.725917:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784581.749589:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784582.772653:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784583.797745:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784584.820898:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784585.524512:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784575/real 1787784575] req@ffff9431ba258f00 x1874627643140096/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784585.524547:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431ba258f00 x1874627643140096/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787784585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784585.524559:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784575/real 1787784575] req@ffff943081d261c0 x1874627643139840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784585.524570:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff943081d261c0 x1874627643139840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787784585.524586:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943186999000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784585.524672:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787784585.524677:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba258f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643140096:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787784585.524683:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf181000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787784585.524699:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643139840:0@lo:39:umount.0 00000100:00080000:3.0:1787784585.524797:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00080000:1.0:1787784585.524799:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1787784585.524803:0:13158:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787784585.524809:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787784585.524816:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787784585.524819:0:475:0:(import.c:65:import_set_state_nolock()) ffff943186999000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784585.524825:0:475:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 390 00000100:00080000:1.0:1787784585.524830:0:475:0:(import.c:589:import_select_connection()) MGC192.168.202.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787784585.524838:0:475:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import ffff943186999000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784585.524872:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b7840 x1874627643140352/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784585.524955:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787784585.524969:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643140480:0@lo:400:kworker.0 00000400:00000100:1.0:1787784585.525024:0:3295:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643140480 offset 0 length 224: 4 00000100:00100000:0.0:1787784585.525526:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643140352:0@lo:250:kworker.0 00000400:00000100:0.0:1787784585.525553:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874627643140352 offset 0 length 520: 4 00010000:00010000:3.0:1787784585.525724:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525737:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525744:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525767:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525792:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784585.525800:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525806:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525812:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525818:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784585.525838:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787784585.525843:0:13158:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787784585.525864:0:13158:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787784585.525868:0:13158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787784585.525872:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784585.525879:0:13158:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784585.525883:0:13158:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff943185783370) has no exports 00000020:00080000:3.0:1787784585.525905:0:13158:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff943185783370) has no exports 00000020:01000000:3.0:1787784585.527690:0:13158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94319047de40 - data ffff9431bfebc288/ffff9431b9dcec00 00000020:01000000:3.0:1787784585.533017:0:13158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94318694ec60 - data ffff94319dafa438/ffff9431bf16f400 00010000:00010000:1.0:1787784585.537051:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784585.537068:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784585.537080:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513e00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:1.0:1787784585.537084:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784585.537095:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784585.537125:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784585.537130:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787784585.537133:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787784585.537137:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787784585.537161:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:1.0:1787784585.537166:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784585.537173:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181513e00/0xffb8d925c20ba9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba9c0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784585.537262:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784585.537269:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784585.537278:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784585.537282:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784585.537289:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784585.537292:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784585.537301:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784585.537306:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787784585.537309:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787784585.537311:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787784585.537319:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:2.0:1787784585.537321:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784585.537327:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185611a00/0xffb8d925c20babf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20babf7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784585.537337:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784585.537344:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784585.537347:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787784585.550706:0:13158:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787784585.592895:0:13158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba7c8 00000020:00000080:1.0:1787784585.592907:0:13158:0:(genops.c:885:class_export_put()) final put ffff9431863b6000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787784585.592932:0:13158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b9ffe000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787784585.592936:0:13158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9ffe000 2 00000020:01000004:1.0:1787784585.592939:0:13158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9431b9ffe000 from lustre-OST0000 00000020:00000080:1.0:1787784585.592966:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784585.592976:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787784585.592980:0:13158:0:(genops.c:885:class_export_put()) final put ffff9431b9557800/lustre-OST0000_UUID 00000020:00000080:1.0:1787784585.592982:0:13158:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9557800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787784585.592990:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787784585.593045:0:13158:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787784585.593051:0:13158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787784585.593054:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784585.593059:0:13158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787784585.593066:0:13158:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9431bed65000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787784585.593071:0:13158:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9431b5c44d28) has exports, disconnecting them 00000020:00080000:1.0:1787784585.593090:0:13158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9431bed65000), last request at 1787784335 00000020:00000080:1.0:1787784585.593094:0:13158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba7f2 00000020:00080000:1.0:1787784585.593102:0:13158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bed65000): rc 0 00000020:00000080:1.0:1787784585.593108:0:13158:0:(genops.c:885:class_export_put()) final put ffff9431bed65000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787784585.593823:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431863b6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787784585.593879:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bed65000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787784585.594452:0:13158:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787784585.594458:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784585.594463:0:13158:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787784585.594469:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787784585.594690:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784585.594699:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787784585.594706:0:13158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9ffe000 1 00000020:00000080:0.0:1787784585.594712:0:13158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba782 00000020:00000080:0.0:1787784585.594719:0:13158:0:(genops.c:885:class_export_put()) final put ffff9431863b3800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787784585.594724:0:13158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787784585.594731:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784585.594735:0:13158:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787784585.594738:0:13158:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9431b5c43370) has no exports 00000020:00000080:2.0:1787784585.595169:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf181000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787784585.595177:0:475:0:(genops.c:885:class_export_put()) final put ffff9431bf185800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787784585.595180:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf185800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787784585.595189:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787784585.595270:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431863b3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787784585.626421:0:13158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787784585.626437:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787784585.626443:0:13158:0:(genops.c:885:class_export_put()) final put ffff9431b9ffd000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787784585.626562:0:13158:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9ffd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787784585.626575:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787784585.626826:0:13158:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9431b9ffc000 00000020:02000400:0.0:1787784585.626880:0:13158:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787784585.961124:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784586.996575:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784588.022157:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787784588.583121:0:13311:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787784588.607743:0:13311:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787784588.607829:0:13311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784588.608171:0:13311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784588.608179:0:13311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784588.608185:0:13311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784588.608217:0:13311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787784588.608223:0:13311:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787784588.608254:0:13311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787784588.608266:0:13311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45ae580 x1874627643139712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784591 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784588.608290:0:13311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431ba25ad00 x1874627643140224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784588.608328:0:13311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45b4000 x1874627643140480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784601 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784588.608335:0:13311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787784588.608340:0:13311:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787784588.608399:0:13311:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787784588.608409:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643139712:0@lo:400:kworker.0 00000100:00100000:1.0:1787784588.608501:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643140480:0@lo:400:kworker.0 00000100:00100000:1.0:1787784588.608512:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643140224:0@lo:400:kworker.0 00010000:00010000:0.0:1787784588.608660:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784588.608667:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784588.608675:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784588.608678:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784588.608687:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784588.608695:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784588.608701:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787784588.608704:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787784588.608707:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787784588.608719:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:0.0:1787784588.608724:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784588.608731:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0a00/0xffb8d925c20ba98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba996 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784588.608743:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784588.608744:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784588.608746:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784588.608764:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643140608:0@lo:39:umount.0 00000400:00000100:0.0:1787784588.608815:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874627643140608 offset 0 length 224: 4 00010000:00010000:1.0:1787784589.044668:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784590.068672:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787784590.644607:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787784590.644633:0:475:0:(pinger.c:247:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787784591.092624:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784592.116628:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784593.143317:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784594.164744:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784595.188638:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784595.765582:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787784595.765594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787784596.213713:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784597.237578:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784598.260643:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784598.837557:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784588/real 1787784588] req@ffff9431ba25b480 x1874627643140608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784598 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784598.837590:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431ba25b480 x1874627643140608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787784598 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784598.837610:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787784598.837628:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643140608:0@lo:39:umount.0 00000100:00080000:0.0:1787784598.839087:0:13311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787784598.839094:0:13311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787784598.839101:0:13311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787784598.841527:0:13311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841548:0:13311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841556:0:13311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841563:0:13311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841699:0:13311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784598.841707:0:13311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841715:0:13311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841720:0:13311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784598.841726:0:13311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847263:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784598.847278:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847299:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512a00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784598.847304:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847314:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784598.847322:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784598.847327:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787784598.847347:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1787784598.847361:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:2.0:1787784598.847387:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847395:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943181512a00/0xffb8d925c20ba99d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba9a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847412:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784598.847415:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847420:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784598.847423:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847430:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784598.847435:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784598.847440:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787784598.847442:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787784598.847445:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:2.0:1787784598.847447:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784598.847453:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784598.847455:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784598.847457:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784598.847910:0:13311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787784598.847919:0:13311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0800/0xffb8d925c20babe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20babe9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784598.847936:0:13311:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787784598.847942:0:13311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787784598.847944:0:13311:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787784598.847975:0:13311:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787784598.847979:0:13311:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787784598.847985:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787784598.847991:0:13311:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787784598.847995:0:13311:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9431b9ec8000) has no exports 00000020:00080000:0.0:1787784598.848020:0:13311:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9431b9ec8000) has no exports 00000020:01000000:0.0:1787784598.859740:0:13311:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff94319047dd20 - data ffff9431bfebce58/ffff9431b9dcd400 00000020:01000000:0.0:1787784598.859900:0:13311:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9431b9d95e40 - data ffff9431bfc99bd0/ffff9431bf907400 00010000:00010000:2.0:1787784598.860597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787784598.869953:0:13311:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787784598.902970:0:13311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba893 00000020:00000080:1.0:1787784598.902982:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431b9ffa000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787784598.903351:0:13311:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431bf2b0000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787784598.903355:0:13311:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431bf2b0000 2 00000020:01000004:1.0:1787784598.903359:0:13311:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9431bf2b0000 from lustre-OST0001 00000020:00000080:1.0:1787784598.903421:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784598.903433:0:13311:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787784598.903437:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431bf2b7000/lustre-OST0001_UUID 00000020:00000080:1.0:1787784598.903440:0:13311:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf2b7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787784598.903449:0:13311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787784598.903572:0:13311:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5->MGS 00010000:00010000:1.0:1787784598.903588:0:13311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784598.903614:0:13311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784598.903619:0:13311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787784598.903622:0:13311:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787784598.903625:0:13311:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787784598.903638:0:13311:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:1.0:1787784598.903642:0:13311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943180031c00/0xffb8d925c20ba7a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba7ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784598.903658:0:13311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787784598.903664:0:13311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784598.903669:0:13311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787784598.903672:0:13311:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787784598.903673:0:13311:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787784598.903682:0:13311:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff943186999000 00010000:00010000:1.0:1787784598.903685:0:13311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf7f0600/0xffb8d925c20ba9e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xffb8d925c20ba9ea expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787784598.903699:0:13311:0:(import.c:65:import_set_state_nolock()) ffff943186999000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787784598.903703:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787784598.903705:0:13311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787784598.903706:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787784598.903711:0:13311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787784598.903720:0:13311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9431b45b7840 x1874627643140352/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787784600 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787784598.903745:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787784598.903748:0:13311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1787784598.903827:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5:3292:1874627643140352:0@lo:250:kworker.0 00000020:00000080:2.0:1787784598.903904:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9ffa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1787784598.904273:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787784598.904281:0:13311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba686 00000020:00000080:1.0:1787784598.904287:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431857df000/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 00000020:01000000:1.0:1787784598.904342:0:13311:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.159@tcp (flags='') 00000020:00000080:1.0:1787784598.904348:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784598.904353:0:13311:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787784598.904357:0:13311:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9431857819b8) has no exports 10000000:01000000:3.0:1787784598.907795:0:5828:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787784598.908270:0:13311:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.159@tcp: client import never connected 00000100:00080000:1.0:1787784598.908279:0:13311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787784598.908285:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787784598.908288:0:13311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787784598.908291:0:13311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787784598.908552:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431857df000/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 for MGC192.168.202.159@tcp 00000020:00000080:1.0:1787784598.912401:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787784598.912415:0:13311:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.159@tcp (uuid 32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5) 00000020:01000000:1.0:1787784598.912423:0:13311:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787784598.912431:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787784598.912436:0:13311:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787784598.912445:0:13311:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9431bf187000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787784598.912451:0:13311:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9431908fb370) has exports, disconnecting them 00000020:00080000:1.0:1787784598.912456:0:13311:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9431bf187000), last request at 1787784358 00000020:00000080:1.0:1787784598.912461:0:13311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba8bd 00000020:00080000:1.0:1787784598.912475:0:13311:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9431bf187000): rc 0 00000020:00000080:1.0:1787784598.912480:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431bf187000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787784598.913758:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff943186999000 for MGC192.168.202.159@tcp 00000020:00000080:2.0:1787784598.913768:0:475:0:(genops.c:885:class_export_put()) final put ffff9431909f7800/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 00000020:00000080:2.0:1787784598.913771:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431909f7800/32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5 for MGC192.168.202.159@tcp 00000020:01000000:2.0:1787784598.913781:0:475:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.159@tcp (32c50ae2-cd88-4dd2-aba9-d5b8f3b042b5) 00000020:00000080:2.0:1787784598.914104:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf187000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787784598.995806:0:13311:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787784598.995816:0:13311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787784598.995821:0:13311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787784598.995829:0:13311:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787784598.995999:0:475:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9431bf6e8000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787784599.000204:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787784599.000332:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1787784599.001091:0:8442:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9431bed8e800:8442] 2 exiting: rc = 0 00000100:00100000:1.0:1787784599.002330:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff943186f2e000:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1787784599.002474:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff943187083200:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1787784599.002784:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.007825:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff94319090c000:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1787784599.008009:0:8443:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9431bed8e400:8443] 3 exiting: rc = 0 00000100:00100000:2.0:1787784599.008080:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff943186856000:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1787784599.008350:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff943186856a00:5818] 2 exiting: rc = 0 00000100:00100000:3.0:1787784599.011281:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011292:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011298:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011304:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011310:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011316:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011320:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011327:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011333:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011339:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011344:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011350:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011356:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011362:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011402:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011408:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011415:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011420:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011427:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011432:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011437:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011442:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011447:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011453:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011459:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011464:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011486:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011491:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011497:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011503:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011508:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011513:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011518:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011523:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011529:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011534:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011539:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011544:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011549:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011554:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011559:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011565:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011570:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011575:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011580:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011586:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011591:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011596:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011602:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011608:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011612:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011617:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011622:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011627:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011632:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011637:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011642:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011648:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011653:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011658:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011664:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011676:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011681:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.011686:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787784599.015190:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784599.015204:0:13311:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787784599.015210:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431bf6ef000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787784599.015288:0:13311:0:(genops.c:844:class_export_destroy()) destroying export ffff9431bf6ef000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787784599.015296:0:13311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787784599.015352:0:13311:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431bf2b0000 1 00000020:00000080:3.0:1787784599.015359:0:13311:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xffb8d925c20ba862 00000020:00000080:3.0:1787784599.015452:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431b42bd800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787784599.015469:0:13311:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787784599.015474:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784599.015479:0:13311:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787784599.015483:0:13311:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9431908f99b8) has no exports 00000020:00000080:2.0:1787784599.015894:0:475:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b42bd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787784599.062113:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784599.062128:0:13311:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787784599.062134:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431b9554800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787784599.062139:0:13311:0:(genops.c:844:class_export_destroy()) destroying export ffff9431b9554800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787784599.062149:0:13311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787784599.062341:0:13311:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9431bf2b4800 00000020:01000000:3.0:1787784599.062388:0:13311:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787784599.062393:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787784599.062397:0:13311:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787784599.062402:0:13311:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9431b9eccd28) has no exports 00000020:00000080:3.0:1787784599.062433:0:13311:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787784599.062440:0:13311:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787784599.062443:0:13311:0:(genops.c:885:class_export_put()) final put ffff9431863b3000/OSS_uuid 00000020:00000080:3.0:1787784599.062445:0:13311:0:(genops.c:844:class_export_destroy()) destroying export ffff9431863b3000/OSS_uuid for OSS 00000020:01000000:3.0:1787784599.062449:0:13311:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787784599.064010:0:5827:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787784599.064165:0:12520:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff94318148d800:12520] 4 exiting: rc = 0 00000100:00100000:3.0:1787784599.065478:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff943190465e00:6677] 0 exiting: rc = 1 00000100:00100000:0.0:1787784599.065934:0:8198:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9431b9fb4e00:8198] 3 exiting: rc = 0 00000100:00100000:0.0:1787784599.066010:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff943190464000:6678] 1 exiting: rc = 0 00000100:00100000:0.0:1787784599.066054:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff943189120400:6679] 2 exiting: rc = 0 00000100:00100000:3.0:1787784599.066334:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066429:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066440:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066448:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066453:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066458:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066463:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066470:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066475:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066481:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066486:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066491:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066497:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066503:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066508:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066514:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066519:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066524:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066529:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066534:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066539:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066543:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066548:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066556:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066563:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066571:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066577:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066582:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066645:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066653:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066660:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066665:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066670:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066675:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066680:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066684:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066698:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066703:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066708:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066714:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066719:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066724:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066729:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066735:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066739:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066745:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066750:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066755:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066759:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066765:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066769:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066774:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066779:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066784:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066789:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066795:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066800:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066805:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066809:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066814:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066819:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066824:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066828:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.066834:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.068483:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff943189121400:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1787784599.068632:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff943186f36600:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1787784599.070308:0:11854:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff943190b04e00:11854] 2 exiting: rc = 0 00000100:00100000:3.0:1787784599.071105:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071114:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071119:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071124:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071129:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071134:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071151:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071155:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071160:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071165:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071170:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071175:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071179:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071184:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071188:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071192:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071197:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071201:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071206:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071210:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071216:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071220:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071225:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071229:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071234:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071240:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071245:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071250:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071254:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071259:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071264:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071268:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071273:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071277:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071282:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071286:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071292:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071296:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071302:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071309:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071315:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071328:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071333:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071338:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071343:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071347:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071352:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071357:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071388:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071395:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071400:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071405:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071410:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071414:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071419:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071424:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071429:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071434:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071438:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071446:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071451:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071456:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071461:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.071467:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.072352:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff943190464600:6685] 2 exiting: rc = 0 00000100:00100000:3.0:1787784599.072553:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff94318627cc00:6684] 1 exiting: rc = 0 00000100:00100000:3.0:1787784599.076900:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff943190464a00:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1787784599.085006:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085017:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085024:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085031:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085037:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085043:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085049:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085054:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085073:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085080:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085086:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085092:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085120:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085128:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085134:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085141:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085147:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085152:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085158:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085163:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085169:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085174:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085179:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085185:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085192:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085198:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085204:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085210:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085216:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085222:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085228:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085530:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085539:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085544:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085550:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085556:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085577:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085584:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085611:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085617:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085622:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085627:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085632:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085645:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085650:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085655:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085661:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085665:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085671:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085676:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085681:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085687:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085740:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085747:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085752:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085757:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085762:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085768:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085773:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085777:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085782:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085786:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085791:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.085796:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096004:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9431b6bae400:6687] 1 exiting: rc = 0 00000100:00100000:3.0:1787784599.096569:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9431b6baea00:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1787784599.096634:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096643:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096648:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096653:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096658:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096663:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096668:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096673:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096678:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096684:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096689:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096694:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096715:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096721:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096726:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096730:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096735:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096741:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096747:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096752:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096757:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096763:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096768:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096774:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096779:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096785:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096789:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096794:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096800:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096807:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096812:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096818:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096824:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096832:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096838:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096843:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096896:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096901:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096906:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096922:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096928:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096933:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096939:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096945:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096950:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096955:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096959:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096974:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096980:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096985:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.096993:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097000:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097006:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097011:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097016:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097021:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097027:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097033:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097038:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097042:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097048:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097053:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097059:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.097065:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787784599.102985:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff94318627d800:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1787784599.103093:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff94318627c400:6689] 1 exiting: rc = 0 00000100:00100000:3.0:1787784599.103442:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103451:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103458:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103465:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103472:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103479:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103485:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103490:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103496:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103505:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103524:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103531:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103536:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103541:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103546:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103551:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103557:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103562:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103580:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103586:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103592:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103597:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103616:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103624:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103630:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103636:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103645:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103651:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103657:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103663:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103669:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103674:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103680:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103685:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103707:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103714:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103719:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103725:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103730:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103735:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103741:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103746:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103752:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103757:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103762:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103767:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103786:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103795:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103801:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103806:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103813:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103818:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103823:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103835:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103841:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103847:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103853:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103859:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103879:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103886:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103892:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103897:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103903:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787784599.103910:0:13311:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787784599.128975:0:13311:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787784618.174184:0:13927:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787784627.028191:0:14398:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787784627.028197:0:14398:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787784627.028299:0:14398:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431b9fc6000 00000020:01000004:2.0:1787784627.028315:0:14398:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787784627.028324:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787784627.028338:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9431b9eccd28) 00000020:00000080:2.0:1787784627.028351:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787784627.052074:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787784627.054791:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787784627.055278:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787784627.055523:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787784627.055593:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787784627.056255:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787784627.056425:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787784627.056531:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787784627.056636:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787784627.057172:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787784627.059848:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 645: rc = 0 00100000:10000000:2.0:1787784627.060039:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 645: rc = 0 00100000:10000000:2.0:1787784627.060938:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 770: rc = 0 00100000:10000000:2.0:1787784627.061523:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1787784627.062309:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784627.062955:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:2.0:1787784627.063286:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784627.063878:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 770: rc = 0 00100000:10000000:2.0:1787784627.064166:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 770: rc = 0 00100000:10000000:3.0:1787784627.065097:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 770: rc = 0 00100000:10000000:3.0:1787784627.065512:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 770: rc = 0 00100000:10000000:3.0:1787784627.065840:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 770: rc = 0 00100000:10000000:3.0:1787784627.066155:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 770: rc = 0 00100000:10000000:3.0:1787784627.066794:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1787784627.068018:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 664: rc = 0 00100000:10000000:3.0:1787784627.069001:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 664: rc = 0 00100000:10000000:3.0:1787784627.069591:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 664: rc = 0 00100000:10000000:3.0:1787784627.070569:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 664: rc = 0 00100000:10000000:3.0:1787784627.071140:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 664: rc = 0 00100000:10000000:3.0:1787784627.072083:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 664: rc = 0 00100000:10000000:3.0:1787784627.072629:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 664: rc = 0 00100000:10000000:3.0:1787784627.073028:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 664: rc = 0 00100000:10000000:3.0:1787784627.073489:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 664: rc = 0 00100000:10000000:3.0:1787784627.073824:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 664: rc = 0 00100000:10000000:0.0:1787784627.079323:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 664: rc = 0 00100000:10000000:0.0:1787784627.079880:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 664: rc = 0 00100000:10000000:0.0:1787784627.080106:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 664: rc = 0 00100000:10000000:0.0:1787784627.080345:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 664: rc = 0 00100000:10000000:0.0:1787784627.080834:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 664: rc = 0 00100000:10000000:0.0:1787784627.081243:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 664: rc = 0 00100000:10000000:0.0:1787784627.081620:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 664: rc = 0 00100000:10000000:0.0:1787784627.081958:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 664: rc = 0 00100000:10000000:0.0:1787784627.082231:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 664: rc = 0 00100000:10000000:0.0:1787784627.082519:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 664: rc = 0 00100000:10000000:0.0:1787784627.083015:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 664: rc = 0 00100000:10000000:0.0:1787784627.083277:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 664: rc = 0 00100000:10000000:0.0:1787784627.083800:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 664: rc = 0 00100000:10000000:0.0:1787784627.084254:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 664: rc = 0 00100000:10000000:0.0:1787784627.084719:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 664: rc = 0 00100000:10000000:0.0:1787784627.085065:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 664: rc = 0 00100000:10000000:0.0:1787784627.085790:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 664: rc = 0 00100000:10000000:0.0:1787784627.086252:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 664: rc = 0 00100000:10000000:0.0:1787784627.087995:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 664: rc = 0 00100000:10000000:0.0:1787784627.088597:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 664: rc = 0 00100000:10000000:0.0:1787784627.089018:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 664: rc = 0 00100000:10000000:0.0:1787784627.089551:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 664: rc = 0 00100000:10000000:0.0:1787784627.090064:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 559: rc = 0 00100000:10000000:0.0:1787784627.092344:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787784627.093132:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 646: rc = 0 00100000:10000000:0.0:1787784627.093755:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787784627.093825:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 646: rc = 0 00100000:10000000:0.0:1787784627.094100:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787784627.094267:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 646: rc = 0 00100000:10000000:0.0:1787784627.094807:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787784627.094958:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:1.0:1787784627.095742:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787784627.095844:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:1.0:1787784627.096139:0:14398:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787784627.096294:0:14398:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00000020:00000080:1.0:1787784627.096846:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787784627.096855:0:14398:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784627.096941:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bb987 00000020:01000004:1.0:1787784627.096951:0:14398:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787784627.096955:0:14398:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787784627.096960:0:14398:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431b9fc6000 from MGS 00000020:01000004:1.0:1787784627.096964:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787784627.096974:0:14398:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff943185783370) 00000020:00000080:1.0:1787784627.096985:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787784627.097041:0:14398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b9fc6000 from MGS, refs=2 00080000:01000000:1.0:1787784627.097046:0:14398:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787784627.097051:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bb995 00000100:00100000:1.0:1787784627.097263:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787784627.097806:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787784627.097814:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787784627.104291:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787784627.104310:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787784627.105290:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784627.105747:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787784627.105755:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787784627.113031:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787784627.113052:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787784627.114587:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787784627.114597:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787784627.115360:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.115390:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.115392:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.115938:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.115948:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.115950:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784627.119779:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787784627.125264:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787784627.138012:0:14398:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787784627.138034:0:14398:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787784627.138036:0:14398:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787784627.140163:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787784627.140345:0:14398:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787784627.140484:0:14398:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787784627.141100:0:14398:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787784627.141616:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784627.141950:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787784627.141957:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787784627.145901:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787784627.145919:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787784627.146674:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787784627.146682:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787784627.151237:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787784627.151257:0:14398:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.159@tcp' 00000020:01000004:3.0:1787784627.151259:0:14398:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787784627.151291:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.159@tcp (typ=mgc) 00000020:00000080:3.0:1787784627.151304:0:14398:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.159@tcp (ffff9431908f99b8) 00000020:00000080:3.0:1787784627.151320:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787784627.151604:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431b9ffa000@MGC192.168.202.159@tcp: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1787784627.151825:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.159@tcp-0 is initialized 00000040:01000000:3.0:1787784627.151832:0:14398:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787784627.152104:0:14412:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787784627.154840:0:14413:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787784627.154995:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.159@tcp (uuid 459db144-24ce-4979-944c-65e392f5ff2a) 00000020:00000080:3.0:1787784627.155027:0:14398:0:(genops.c:1385:class_connect()) connect: client 459db144-24ce-4979-944c-65e392f5ff2a, cookie 0xffb8d925c20bb9a3 00000100:00080000:3.0:1787784627.155042:0:14398:0:(import.c:510:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787784627.155050:0:14398:0:(import.c:624:import_select_connection()) MGC192.168.202.159@tcp: import ffff9431b9ffa000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1787784627.155087:0:14398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff943081d25e00 x1874627643140736/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787784627.155151:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:459db144-24ce-4979-944c-65e392f5ff2a:3292:1874627643140736:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787784627.155237:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787784627.155310:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 459db144-24ce-4979-944c-65e392f5ff2a->MGS 00000020:01000004:3.0:1787784627.155336:0:14398:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787784627.155341:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787784627.155356:0:14398:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9431908fb370) 00000020:00000080:3.0:1787784627.155970:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787784627.156537:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643140736 00000100:00100000:2.0:1787784627.156547:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643140736 00000100:00100000:2.0:1787784627.156593:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784627.156604:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3292:x1874627643140736:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787784627.156636:0:14408:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 459db144-24ce-4979-944c-65e392f5ff2a@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1787784627.157583:0:14408:0:(genops.c:1385:class_connect()) connect: client 459db144-24ce-4979-944c-65e392f5ff2a, cookie 0xffb8d925c20bb9b1 00000100:00080000:2.0:1787784627.158030:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9431bedb4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784627.158136:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+5:3292:x1874627643140736:12345-0@lo:250:mount.lustre.0 Request processed in 1532us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.158158:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784627.158256:0:3292:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787784627.158266:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.159@tcp: connect to target with instance 0 00000100:00080000:2.0:1787784627.158274:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787784627.158279:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787784627.158283:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b9ffa000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787784627.158286:0:3292:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787784627.158304:0:3292:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787784627.158310:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:459db144-24ce-4979-944c-65e392f5ff2a:3292:1874627643140736:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787784627.184175:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784627.184627:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787784627.184636:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787784627.189472:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784627.189487:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787784627.190536:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787784627.190545:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787784627.191247:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784627.192746:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787784627.192756:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787784627.195044:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787784627.195060:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787784627.253910:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787784627.254123:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787784627.254131:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787784627.256295:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787784627.256311:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787784627.257297:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784627.257610:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787784627.257616:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787784627.258084:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787784627.258092:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787784627.258723:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784627.258933:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787784627.258939:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787784627.266161:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787784627.266175:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787784627.266915:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784627.267082:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787784627.267087:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787784627.282721:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787784627.286510:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787784627.321835:0:14398:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784627.322062:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784627.322069:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787784627.326734:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787784627.326753:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787784627.328085:0:14398:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787784627.328097:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787784627.329399:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787784627.329427:0:14398:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787784627.329446:0:14398:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787784627.329594:0:14398:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787784627.329643:0:14398:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787784627.329649:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787784627.329651:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784627.329653:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784627.329654:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784627.329656:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784627.329657:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784627.329659:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784627.329660:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784627.329662:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784627.329664:0:14398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784627.329667:0:14398:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787784627.329670:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787784627.329671:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784627.329673:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784627.329674:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784627.329675:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784627.329676:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784627.329677:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784627.329678:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784627.329679:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784627.329680:0:14398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787784627.329710:0:14398:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787784627.329733:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643140864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787784627.329809:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.329871:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431867c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.330104:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643140864 00000100:00100000:0.0:1787784627.330119:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643140864 00000100:00100000:0.0:1787784627.330170:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784627.330180:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+5:14398:x1874627643140864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787784627.330229:0:14411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787784627.330232:0:14411:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787784627.330235:0:14411:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787784627.331200:0:14431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787784627.331905:0:14411:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787784627.333298:0:14432:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787784627.333315:0:14432:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787784627.333319:0:14432:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787784627.333357:0:14432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787784627.334067:0:14411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787784627.334077:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787784627.345301:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+5:14398:x1874627643140864:12345-0@lo:253:mount.lustre.0 Request processed in 15113us (15482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.345323:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784627.345945:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643140864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787784627.346031:0:14398:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787784627.346048:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787784627.346050:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787784627.346051:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787784627.346053:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787784627.346054:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787784627.346055:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787784627.346057:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787784627.346058:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787784627.346060:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787784627.346062:0:14398:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787784627.346081:0:14398:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431b9fc6000 from lustre-MDT0000 10000000:01000000:3.0:1787784627.346118:0:14398:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787784627.346122:0:14398:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784627.346127:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9431908f99b8 10000000:01000000:3.0:1787784627.346132:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784627.346139:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9431908f99b8 from 1 10000000:01000000:3.0:1787784627.346142:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787784627.346178:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.346189:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.346199:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.346219:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643140992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784627.346327:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.346449:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.346608:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643140992 00000100:00100000:2.0:1787784627.346615:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643140992 00000100:00100000:2.0:1787784627.346818:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784627.346828:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+5:14398:x1874627643140992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784627.346842:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784627.346857:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500400/0xffb8d925c20bb9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bb9b8 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.346880:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500400/0xffb8d925c20bb9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bb9b8 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.346891:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500400/0xffb8d925c20bb9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bb9b8 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.346913:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500400, rc 0) 00000100:00100000:2.0:1787784627.347030:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+6:14398:x1874627643140992:12345-0@lo:101:mount.lustre.0 Request processed in 203us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.347036:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784627.347118:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643140992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784627.347133:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.347152:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.347205:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784627.347245:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.347417:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784627.347641:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141120 00000100:00100000:1.0:1787784627.347646:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141120 00000100:00100000:1.0:1787784627.347682:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784627.347690:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+6:14398:x1874627643141120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784627.347930:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+6:14398:x1874627643141120:12345-0@lo:501:mount.lustre.0 Request processed in 241us (684us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787784627.347939:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784627.348125:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141120:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787784627.348155:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787784627.348172:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.348182:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784627.348191:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431b9fc6000 10000000:01000000:3.0:1787784627.348196:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787784627.348200:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9431b9fc6000 10000000:01000000:3.0:1787784627.348203:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787784627.348206:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9431b9fc6000 from 1 10000000:01000000:3.0:1787784627.348208:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787784627.348242:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.348251:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.348259:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.348284:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784627.348319:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.348331:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784627.348678:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141248 00000100:00100000:1.0:1787784627.348683:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141248 00000100:00100000:1.0:1787784627.348707:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784627.348715:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+6:14398:x1874627643141248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784627.348726:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784627.348752:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1000/0xffb8d925c20bb9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bb9c6 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.348773:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1000/0xffb8d925c20bb9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bb9c6 expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.348784:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1000/0xffb8d925c20bb9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bb9c6 expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.348791:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1000, rc 0) 00000100:00100000:1.0:1787784627.348825:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+7:14398:x1874627643141248:12345-0@lo:101:mount.lustre.0 Request processed in 112us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.348833:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787784627.349018:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784627.349031:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.349040:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784627.349053:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787784627.349069:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.349075:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610800/0xffb8d925c20bb9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9cd expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784627.349082:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787784627.349086:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784627.349090:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9431b9fc6000 10000000:01000000:3.0:1787784627.349093:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787784627.349096:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787784627.349098:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787784627.349126:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.349133:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.349148:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.349163:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784627.349193:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.349215:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784627.349350:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141376 00000100:00100000:1.0:1787784627.349355:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141376 00000100:00100000:1.0:1787784627.349493:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787784627.349578:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+7:14398:x1874627643141376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784627.349588:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784627.349600:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1600/0xffb8d925c20bb9db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bb9d4 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.349617:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1600/0xffb8d925c20bb9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bb9d4 expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.349743:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1600/0xffb8d925c20bb9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bb9d4 expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.349753:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1600, rc 0) 00000100:00100000:1.0:1787784627.349794:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+8:14398:x1874627643141376:12345-0@lo:101:mount.lustre.0 Request processed in 218us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.349812:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784627.350014:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784627.350026:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.350034:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.350085:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784627.350127:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.350157:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784627.350209:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141504 00000100:00100000:1.0:1787784627.350214:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141504 00000100:00100000:1.0:1787784627.350397:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787784627.350405:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+8:14398:x1874627643141504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784627.350855:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+9:14398:x1874627643141504:12345-0@lo:501:mount.lustre.0 Request processed in 449us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.350863:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784627.351178:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784627.351218:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784627.351346:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.351864:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.351906:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141632 00000100:00100000:0.0:1787784627.351912:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141632 00000100:00100000:0.0:1787784627.351945:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784627.351952:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+9:14398:x1874627643141632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784627.352309:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+9:14398:x1874627643141632:12345-0@lo:503:mount.lustre.0 Request processed in 356us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.352316:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787784627.352642:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643141632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784627.353788:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14433:1874627643141760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784627.353855:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.353939:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431befa0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.353983:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643141760 00000100:00100000:0.0:1787784627.353988:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643141760 00000100:00100000:0.0:1787784627.354069:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784627.354078:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+9:14433:x1874627643141760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784627.354859:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+9:14433:x1874627643141760:12345-0@lo:502:llog_process_th.0 Request processed in 780us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.354868:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784627.355024:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14433:1874627643141760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784627.355053:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.355065:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.355067:0:14433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787784627.355072:0:14433:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787784627.355075:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784627.355089:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff943185784d28) 00000020:00000080:1.0:1787784627.355105:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787784627.359613:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787784627.359852:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787784627.359864:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bb9e9 00000020:00000080:1.0:1787784627.360085:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787784627.360091:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.360095:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.360097:0:14433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787784627.360099:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.360121:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.360123:0:14433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787784627.360127:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784627.360139:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff943185780000) 00000020:00000080:1.0:1787784627.360153:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787784627.360158:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787784627.360161:0:14433:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787784627.360164:0:14433:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787784627.360170:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787784627.362327:0:14433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b9fc6000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787784627.362362:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9431857819b8) 00000020:00000080:1.0:1787784627.362587:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787784627.362756:0:14433:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787784627.362764:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bb9fe 00000020:00000080:1.0:1787784627.362899:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787784627.362906:0:14433:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787784627.362910:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xffb8d925c20bba05 00080000:01000000:1.0:1787784627.362916:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787784627.362920:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bba0c 00010000:00010000:3.0:1787784627.495767:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787784627.496214:0:14433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787784627.496586:0:14433:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787784627.501359:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9431908f8000) 00000020:00000080:3.0:1787784627.501424:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787784627.501553:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787784627.501561:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bba1a 00000020:00000080:1.0:1787784627.530818:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787784627.538143:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xffb8d925c20bba21 00000020:00000080:1.0:1787784627.538753:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787784627.538769:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.538777:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.538779:0:14433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787784627.538782:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.538789:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.538791:0:14433:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787784627.538795:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787784627.538832:0:14433:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787784627.538845:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.538848:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.538849:0:14433:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787784627.538859:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784627.538861:0:14433:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787784627.538863:0:14433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784627.538864:0:14433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784627.538866:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784627.538868:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.538870:0:14433:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784627.538872:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784627.538875:0:14433:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787784627.538879:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.538880:0:14433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787784627.538883:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787784627.538888:0:14433:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:1.0:1787784627.538920:0:14433:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787784627.538923:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784627.539079:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9431b6264d28) 00000020:00000080:1.0:1787784627.539095:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787784627.539103:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787784627.539170:0:14433:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787784627.539177:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787784627.539183:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bba2f 00010000:00080000:1.0:1787784627.539214:0:14433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431b42ba800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1787784627.539611:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787784627.540468:0:14433:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787784627.540561:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787784627.541611:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784627.541674:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787784627.541762:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787784627.542938:0:14438:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787784627.542957:0:14438:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787784627.549088:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787784627.549117:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787784627.549159:0:14433:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787784627.549179:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bba36 00000100:00080000:1.0:1787784627.549191:0:14433:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784627.549212:0:14433:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431b42ba800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784627.549322:0:14433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b7480 x1874627643141888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784627.549416:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643141888:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787784627.549464:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643141888 offset 0 length 520: 4 00000100:00080000:1.0:1787784627.549611:0:14433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787784627.549683:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.549686:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.549687:0:14433:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787784627.549689:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787784627.549691:0:14433:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787784627.549692:0:14433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784627.549693:0:14433:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787784627.549694:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787784627.549696:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.549697:0:14433:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787784627.549698:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787784627.549701:0:14433:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787784627.549703:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.549703:0:14433:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787784627.549705:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787784627.549707:0:14433:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:1.0:1787784627.549721:0:14433:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787784627.549723:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787784627.549732:0:14433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9431b6260000) 00000020:00000080:1.0:1787784627.549740:0:14433:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787784627.549742:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787784627.549782:0:14433:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787784627.549786:0:14433:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787784627.549790:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xffb8d925c20bba44 00010000:00080000:1.0:1787784627.549812:0:14433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff943190323000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1787784627.549995:0:14433:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787784627.550173:0:14433:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787784627.550207:0:14433:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787784627.550797:0:14433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784627.550840:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787784627.550916:0:14433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787784627.551401:0:14440:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784627.551408:0:14440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787784627.552246:0:14433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787784627.552260:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787784627.552293:0:14433:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787784627.552308:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bba4b 00000100:00080000:0.0:1787784627.552318:0:14433:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784627.552323:0:14433:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784627.552400:0:14433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45aed00 x1874627643142016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784627.552446:0:14433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787784627.552508:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.552512:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.552514:0:14433:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787784627.552517:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.552522:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.552523:0:14433:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787784627.552526:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787784627.552528:0:14433:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787784627.552530:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.552533:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.552534:0:14433:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787784627.552536:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.552538:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.552539:0:14433:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787784627.552543:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787784627.552578:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14433:1874627643142144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784627.552635:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643142016:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787784627.552661:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:2.0:1787784627.552671:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643142016 offset 0 length 520: 4 00000100:00100000:1.0:1787784627.552698:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142144 00000100:00100000:1.0:1787784627.552704:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142144 00000100:00100000:1.0:1787784627.552753:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784627.552763:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+9:14433:x1874627643142144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784627.552958:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+9:14433:x1874627643142144:12345-0@lo:502:llog_process_th.0 Request processed in 196us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.552963:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787784627.552991:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784627.553005:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14433:1874627643142144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784627.553027:0:14433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.553030:0:14433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.553031:0:14433:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787784627.553033:0:14433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787784627.553071:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787784627.553085:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787784627.553102:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.553124:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185611400/0xffb8d925c20bb9d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9db expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784627.553132:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9431b9fc6000 from 1 10000000:01000000:1.0:1787784627.553135:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784627.553160:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.553169:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.553177:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784627.553190:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784627.553216:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.553242:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.553261:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142272 00000100:00100000:0.0:1787784627.553271:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142272 00000100:00100000:0.0:1787784627.553292:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787784627.553298:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+9:14398:x1874627643142272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784627.553307:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784627.553320:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bba52 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.553345:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.553356:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.553448:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88800, rc 0) 00000100:00100000:0.0:1787784627.553485:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+10:14398:x1874627643142272:12345-0@lo:101:mount.lustre.0 Request processed in 187us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.553491:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784627.553553:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784627.553565:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.553582:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784627.553995:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142400:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787784627.554023:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.556213:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.556303:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142400 00000100:00100000:2.0:1787784627.556312:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142400 00000100:00100000:2.0:1787784627.556401:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784627.556412:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+10:14398:x1874627643142400:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787784627.556437:0:14408:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787784627.556443:0:14408:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787784627.556546:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+10:14398:x1874627643142400:12345-0@lo:256:mount.lustre.0 Request processed in 136us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.556553:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787784627.556576:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142400:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787784627.557100:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784627.557129:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.557141:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784627.557149:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9fc6000 from 1 10000000:01000000:1.0:1787784627.557152:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784627.557185:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.557193:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.557202:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784627.557231:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787784627.557273:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.558912:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.558958:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142528 00000100:00100000:0.0:1787784627.558967:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142528 00000100:00100000:0.0:1787784627.559020:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787784627.559030:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+10:14398:x1874627643142528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784627.559044:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784627.559062:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bba60 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.559087:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.559094:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.559126:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89800, rc 0) 00000100:00100000:0.0:1787784627.559200:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643142528:12345-0@lo:101:mount.lustre.0 Request processed in 172us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.559208:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784627.559266:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784627.559282:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784627.559290:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784627.559356:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784627.559417:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.559443:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.559471:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142656 00000100:00100000:2.0:1787784627.559475:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142656 00000100:00100000:2.0:1787784627.559508:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784627.559515:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643142656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784627.559913:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643142656:12345-0@lo:501:mount.lustre.0 Request processed in 398us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.559921:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784627.559943:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784627.559972:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784627.560009:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.560035:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185613480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.560145:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142784 00000100:00100000:0.0:1787784627.560151:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142784 00000100:00100000:0.0:1787784627.560185:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787784627.560192:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643142784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784627.560344:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643142784:12345-0@lo:503:mount.lustre.0 Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.560351:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784627.560395:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643142784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784627.561330:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14442:1874627643142912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784627.561406:0:14442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.561439:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.561516:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643142912 00000100:00100000:2.0:1787784627.561520:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643142912 00000100:00100000:2.0:1787784627.561548:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784627.561556:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:14442:x1874627643142912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784627.561770:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:14442:x1874627643142912:12345-0@lo:502:llog_process_th.0 Request processed in 215us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.561776:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784627.561877:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14442:1874627643142912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787784627.561962:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.561970:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.561972:0:14442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787784627.561977:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b9fc6000 00000020:00000080:1.0:1787784627.561979:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784627.561986:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.561992:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.561993:0:14442:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787784627.561995:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.561996:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.561997:0:14442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787784627.561999:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b9fc6000 00000020:00000080:1.0:1787784627.562000:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787784627.562051:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787784627.562055:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.562057:0:14442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787784627.562059:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787784627.562061:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787784627.562062:0:14442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787784627.562066:0:14442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431b9fc6000 00000020:00000080:1.0:1787784627.562068:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787784627.562105:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14442:1874627643143040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787784627.562147:0:14442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784627.562212:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.562308:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143040 00000100:00100000:2.0:1787784627.562312:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143040 00000100:00100000:2.0:1787784627.562343:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787784627.562351:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14442:x1874627643143040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784627.563793:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14442:x1874627643143040:12345-0@lo:502:llog_process_th.0 Request processed in 1436us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.563804:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787784627.564007:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14442:1874627643143040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787784627.564040:0:14442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784627.564048:0:14442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784627.564050:0:14442:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784627.564055:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787784627.564355:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787784627.564562:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784627.564585:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.564598:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784627.564825:0:14398:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784627.564829:0:14398:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431b9fc6000 10000000:01000000:2.0:1787784627.564832:0:14398:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431b9fc6000 10000000:01000000:2.0:1787784627.564836:0:14398:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784627.564843:0:14398:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431b9fc6000 from 1 10000000:01000000:2.0:1787784627.564845:0:14398:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784627.564961:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.564969:0:14398:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.564978:0:14398:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784627.564999:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784627.565045:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.565086:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784627.565155:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143168 00000100:00100000:3.0:1787784627.565171:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143168 00000100:00100000:3.0:1787784627.565215:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787784627.565224:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643143168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784627.565501:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784627.565518:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611e00/0xffb8d925c20bba75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bba6e expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.565543:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611e00/0xffb8d925c20bba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bba6e expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.565554:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611e00/0xffb8d925c20bba75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba6e expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.565562:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611e00, rc 0) 00000100:00100000:3.0:1787784627.565658:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143168:12345-0@lo:101:mount.lustre.0 Request processed in 435us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.565664:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787784627.565799:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784627.565815:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.565824:0:14398:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784627.565884:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784627.565913:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.565977:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784627.566080:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143296 00000100:00100000:3.0:1787784627.566085:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143296 00000100:00100000:3.0:1787784627.566167:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787784627.566175:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784627.566456:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143296:12345-0@lo:501:mount.lustre.0 Request processed in 281us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.566464:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784627.566767:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784627.566801:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784627.566844:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.566935:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784627.566979:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143424 00000100:00100000:3.0:1787784627.566983:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143424 00000100:00100000:3.0:1787784627.567056:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787784627.567064:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784627.567266:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143424:12345-0@lo:503:mount.lustre.0 Request processed in 203us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.567274:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784627.567346:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784627.569504:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14444:1874627643143552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784627.569591:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.569653:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff943189f7fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787784627.569771:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143552 00000100:00100000:0.0:1787784627.569779:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143552 00000100:00100000:0.0:1787784627.569827:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787784627.569837:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14444:x1874627643143552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784627.573359:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14444:x1874627643143552:12345-0@lo:502:llog_process_th.0 Request processed in 3513us (3757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784627.573388:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787784627.573538:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14444:1874627643143552:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787784627.573614:0:14444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787784627.573630:0:14444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9431b9ec99b8) 00000020:00000080:2.0:1787784627.573729:0:14444:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787784627.573834:0:14444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b9fc6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787784627.573838:0:14444:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b9fc6000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787784627.573841:0:14444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b9fc6000 4 00010000:00080000:2.0:1787784627.573960:0:14444:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431904c0800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:2.0:1787784627.579338:0:14444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787784627.580233:0:14444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787784627.580338:0:14444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787784627.580353:0:14444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xffb8d925c20bba83 00000100:00080000:2.0:1787784627.580952:0:14444:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787784627.580961:0:14444:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9431904c0800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784627.581010:0:14444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431ba259a40 x1874627643143680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787784627.581058:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643143680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784627.581973:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784627.582046:0:14444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787784627.585142:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14444:1874627643143808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787784627.585236:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784627.585498:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186d8c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.585523:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143808 00000100:00100000:2.0:1787784627.585529:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143808 00000100:00100000:2.0:1787784627.585595:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784627.585604:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+12:14444:x1874627643143808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787784627.586830:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143680 00000100:00100000:0.0:1787784627.586840:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143680 00000100:00100000:2.0:1787784627.587621:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+12:14444:x1874627643143808:12345-0@lo:502:llog_process_th.0 Request processed in 2012us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.587645:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787784627.587730:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:459db144-24ce-4979-944c-65e392f5ff2a:14444:1874627643143808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787784627.587765:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1787784627.588471:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784627.588480:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba2583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643143680:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787784627.588553:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba2583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643143680:12345-0@lo:38:llog_process_th.0 Request processed in 74us (6583us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787784627.588569:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784627.588610:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784627.588617:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431904c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784627.588622:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787784627.588625:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643143680:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787784627.588733:0:14398:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787784627.588755:0:14398:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787784627.588771:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784627.588783:0:14398:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf501800/0xffb8d925c20bba6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba75 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787784627.588844:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787784627.588846:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784627.588847:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784627.588848:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784627.588850:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784627.588851:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784627.588852:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784627.588854:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784627.588856:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784627.588857:0:14398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784627.590575:0:14398:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787784627.590585:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787784627.590587:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784627.590589:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784627.590590:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784627.590592:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784627.590593:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784627.590595:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784627.590596:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784627.590598:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784627.590610:0:14398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787784627.590641:0:14398:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787784627.590663:0:14398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787784627.590753:0:14398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784627.590798:0:14398:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4581240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.591519:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643143936 00000100:00100000:2.0:1787784627.591528:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643143936 00000100:00100000:2.0:1787784627.591580:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784627.591589:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14398:x1874627643143936:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784627.591619:0:14410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787784627.591633:0:14410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787784627.671997:0:14410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784627.672014:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787784627.672534:0:14431:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787784627.672541:0:14431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787784627.672566:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.672584:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.672593:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.672648:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.672671:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 12 pid: 14411 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.673065:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643144064:0@lo:104: 00000100:00100000:3.0:1787784627.673172:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.673302:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318133ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784627.673302:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144064 00000100:00100000:2.0:1787784627.673310:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144064 00000100:00100000:2.0:1787784627.673441:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784627.673461:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643144064:12345-0@lo:104: 00010000:00010000:2.0:1787784627.673476:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.673543:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784627.673550:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643144064:12345-0@lo:104: Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784627.673557:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787784627.673597:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784627.673603:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673611:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784627.673615:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673623:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784627.673631:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784627.673637:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784627.673672:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673678:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784627.673697:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673704:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bba52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba59 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673722:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.673731:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784627.673733:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784627.673762:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643144192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784627.673793:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784627.673851:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144192 00000100:00100000:3.0:1787784627.673855:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144192 00010000:00010000:3.0:1787784627.673874:0:14401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 13 pid: 14411 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784627.673902:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784627.673910:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+13:3293:x1874627643144192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784627.673920:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784627.673924:0:14401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 13 pid: 14411 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673935:0:14401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 13 pid: 14411 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673951:0:14401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673959:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784627.673973:0:14401:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001433596s 00010000:00010000:3.0:1787784627.673978:0:14401:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.673985:0:14401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674003:0:14401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674010:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674015:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784627.674019:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674026:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674035:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784627.674044:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784627.674084:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:459db144-24ce-4979-944c-65e392f5ff2a+13:3293:x1874627643144192:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784627.674091:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784627.674131:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643144192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784627.674307:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88800/0xffb8d925c20bba59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bba52 expref: 12 pid: 14411 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784627.674318:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643144064:0@lo:104: 00010000:00010000:2.0:1787784627.674338:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.674346:0:14431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.674352:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784627.674358:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610600/0xffb8d925c20bba8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784627.685836:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+11:14398:x1874627643143936:12345-0@lo:253:mount.lustre.0 Request processed in 94237us (95071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784627.685852:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787784627.685871:0:14398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:14398:1874627643143936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784627.685885:0:14398:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787784627.685888:0:14398:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784627.685890:0:14398:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787784627.685891:0:14398:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784627.685893:0:14398:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784627.685894:0:14398:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784627.685895:0:14398:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784627.685897:0:14398:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787784627.685898:0:14398:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787784627.685900:0:14398:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784627.685901:0:14398:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787784627.685915:0:14398:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787784627.693496:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784627.693759:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784627.694284:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784627.694543:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784627.695884:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784627.696150:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784627.703352:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784627.703916:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787784627.704217:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787784627.707200:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787784627.708455:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784627.708628:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787784627.756019:0:14398:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787784627.756974:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787784627.757358:0:14456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787784627.758495:0:14456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1787784627.760785:0:14455:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787784627.760791:0:14455:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1787784627.765955:0:14456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787784627.766042:0:14456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787784627.766047:0:14456:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787784627.767117:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787784627.767550:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787784627.768341:0:14398:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787784627.768354:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787784627.770507:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787784627.778090:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787784627.779300:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787784627.779928:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787784627.783288:0:14398:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787784627.792349:0:14398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787784627.862665:0:14398:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787784627.862709:0:14398:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb46dc1ccb988 00100000:10000000:0.0:1787784627.862717:0:14398:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787784627.865473:0:14398:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787784627.865493:0:14398:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787784627.865507:0:14398:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787784627.865555:0:14398:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787784628.148540:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784628.173345:0:14413:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787784628.173355:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9431b9fc6000 from 6 10000000:01000000:0.0:1787784628.173399:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787784628.173455:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784628.173468:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784628.173481:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784628.173507:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643144320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784628.173577:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784628.173631:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf7733c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784628.174498:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144320 00000100:00100000:3.0:1787784628.174508:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144320 00000100:00100000:3.0:1787784628.174581:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784628.174592:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14413:x1874627643144320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784628.174608:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784628.174625:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bba91 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784628.174652:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784628.174663:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784628.174673:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610000, rc 0) 00000100:00100000:3.0:1787784628.174732:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643144320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784628.174740:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787784628.174790:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643144320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784628.174806:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784628.174816:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784628.174885:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643144448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787784628.174921:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784628.174956:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885b90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784628.174970:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144448 00000100:00100000:3.0:1787784628.174974:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144448 00000100:00100000:3.0:1787784628.174998:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784628.175005:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643144448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787784628.175018:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787784628.175033:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787784628.175036:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787784628.175123:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643144448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784628.175130:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787784628.175166:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643144448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787784628.175204:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787784628.175212:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784628.176302:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784628.662109:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784629.175076:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784629.684941:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787784630.197241:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784631.220660:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784632.250449:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787784632.628780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784632.628788:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784632.628791:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787784632.628795:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787784632.628798:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787784632.628801:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787784632.628805:0:38:0:(import.c:65:import_set_state_nolock()) ffff9431904c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787784632.628818:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9431904c0800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784632.628841:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b6d00 x1874627643144704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784632.628871:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784632.628888:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643144576:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.628972:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.629244:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643144704:0@lo:38:kworker.0 00000100:00100000:1.0:1787784632.629284:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784632.629487:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144576 00000100:00100000:1.0:1787784632.629494:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144576 00000100:00100000:1.0:1787784632.629559:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784632.629569:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:3293:x1874627643144576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.629704:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:3293:x1874627643144576:12345-0@lo:400:kworker.0 Request processed in 136us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784632.629712:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787784632.629783:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:459db144-24ce-4979-944c-65e392f5ff2a:3293:1874627643144576:0@lo:400:kworker.0 00000100:00100000:1.0:1787784632.629842:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144704 00000100:00100000:1.0:1787784632.629847:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144704 00000100:00100000:1.0:1787784632.629871:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784632.629876:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643144704:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787784632.629901:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1787784632.629938:0:14417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xffb8d925c20bba9f 00000004:00100000:1.0:1787784632.629954:0:14417:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787784632.630516:0:14417:0:(import.c:65:import_set_state_nolock()) ffff9431bed65000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787784632.630589:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1874627643144704:12345-0@lo:38:kworker.0 Request processed in 710us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784632.630597:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787784632.630866:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431b45b6d00 x1874627643144704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784632.630883:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787784632.630893:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787784632.630898:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787784632.630901:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431904c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787784632.630907:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3292:1874627643144704:0@lo:38:kworker.0 00010000:00010000:3.0:1787784633.274132:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784633.509516:0:14698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787784634.292543:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784635.316603:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784636.348263:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787784636.934740:0:14849:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda7e35f10 20000000:00000080:2.0:1787784636.934759:0:14849:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9431ba43bc00 uarg=0000000000000000 20000000:01000000:2.0:1787784636.934791:0:14849:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787784636.934798:0:14849:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787784636.934803:0:14849:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787784636.946229:0:14850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787784636.946439:0:14849:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787784636.953803:0:14849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787784636.953835:0:14849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784636.953855:0:14849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784636.953864:0:14849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784636.953913:0:14849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784636.953929:0:14849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 11 pid: 14411 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784636.953968:0:14849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14849:1874627643144832:0@lo:104: 00000100:00100000:0.0:1787784636.954118:0:14849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784636.954338:0:14849:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318133a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787784636.954468:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144832 00000100:00100000:2.0:1787784636.954476:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144832 00000100:00100000:2.0:1787784636.954597:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784636.954608:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14849:x1874627643144832:12345-0@lo:104: 00010000:00010000:2.0:1787784636.954622:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.954677:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784636.954683:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14849:x1874627643144832:12345-0@lo:104: Request processed in 78us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784636.954690:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784636.954777:0:14849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14849:1874627643144832:0@lo:104: 00010000:00010000:0.0:1787784636.954797:0:14849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955445:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784636.955452:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955460:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0400 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:2.0:1787784636.955464:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955471:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787784636.955478:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784636.955483:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787784636.955561:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955567:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787784636.955598:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955617:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431829d0400/0xffb8d925c20bba60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba67 expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955633:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784636.955635:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784636.955636:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784636.955658:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787784636.955670:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643144960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784636.955710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784636.955764:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643144960 00000100:00100000:2.0:1787784636.955769:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643144960 00010000:00010000:2.0:1787784636.955790:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 12 pid: 14411 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784636.955812:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784636.955820:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459db144-24ce-4979-944c-65e392f5ff2a+12:3296:x1874627643144960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784636.955832:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784636.955837:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 12 pid: 14411 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955848:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 12 pid: 14411 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955861:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee89800/0xffb8d925c20bba67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bba60 expref: 12 pid: 14411 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955877:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955895:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955909:0:14402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955915:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955922:0:14402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955928:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955932:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784636.955936:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955944:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955958:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.955967:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784636.955998:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459db144-24ce-4979-944c-65e392f5ff2a+11:3296:x1874627643144960:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784636.956005:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787784636.956049:0:14849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.956063:0:14849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784636.956069:0:14849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbaa6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784636.956901:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643144960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784637.377981:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787784637.748745:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784637.748755:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784637.748758:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784637.748761:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784637.748808:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643145216:0@lo:400:kworker.0 00000100:00100000:0.0:1787784637.748833:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784637.748848:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643145088:0@lo:400:kworker.0 00000100:00100000:2.0:1787784637.748882:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784637.748882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784637.748974:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145216 00000100:00100000:3.0:1787784637.748984:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145216 00000100:00100000:3.0:1787784637.749041:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784637.749051:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643145216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784637.750978:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145088 00000100:00100000:1.0:1787784637.750993:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145088 00000100:00100000:1.0:1787784637.751062:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787784637.751072:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:3295:x1874627643145088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784637.751150:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+11:3295:x1874627643145088:12345-0@lo:400:kworker.0 Request processed in 79us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784637.751166:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787784637.753442:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba259680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643145088:0@lo:400:kworker.0 00000100:00100000:1.0:1787784637.753660:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784627/real 1787784627] req@ffff9431b45aed00 x1874627643142016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784637.753682:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431b45aed00 x1874627643142016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784637.753692:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784627/real 1787784627] req@ffff9431b45b7480 x1874627643141888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784637 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784637.753703:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431b45b7480 x1874627643141888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784637 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787784637.753721:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784637.753736:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784637.753739:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643142016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787784637.753745:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787784637.753750:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787784637.753753:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643141888:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787784637.754111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784637.754116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787784637.754119:0:37:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784637.754124:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1787784637.754128:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787784637.754134:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431b42ba800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784637.754170:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431ba25bc00 x1874627643145344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787784637.754200:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784637.754203:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787784637.754219:0:37:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787784637.754223:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:2.0:1787784637.754226:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787784637.754230:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1787784637.754244:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431ba2592c0 x1874627643145472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787784637.754587:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643145344:0@lo:8:kworker.0 00000400:00000100:1.0:1787784637.754642:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643145344 offset 0 length 520: 4 00000100:00100000:1.0:1787784637.754673:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643145472:0@lo:8:kworker.0 00000400:00000100:1.0:1787784637.754692:0:3292:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874627643145472 offset 0 length 520: 4 00000100:00100000:3.0:1787784637.755130:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643145216:12345-0@lo:400:kworker.0 Request processed in 6076us (6245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784637.755150:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787784637.757350:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431ba25b480 x1874627643145216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784637.757383:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643145216:0@lo:400:kworker.0 10000000:01000000:0.0:1787784638.133096:0:14413:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784638.133104:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9fc6000 from 10 10000000:01000000:0.0:1787784638.133110:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784638.133166:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784638.133179:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784638.133190:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784638.133217:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784638.133295:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784638.133342:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318133a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787784638.133407:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145600 00000100:00100000:1.0:1787784638.133415:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145600 00000100:00100000:1.0:1787784638.133479:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784638.133506:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+11:14413:x1874627643145600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784638.133520:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784638.133535:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbaad expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.133569:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.133582:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.133591:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1c00, rc 0) 00000100:00100000:1.0:1787784638.133638:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643145600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784638.133644:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787784638.133690:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784638.133704:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.133713:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784638.133764:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784638.133785:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.133802:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784638.133813:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145728 00000100:00100000:1.0:1787784638.133815:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145728 00000100:00100000:1.0:1787784638.133832:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784638.133843:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643145728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784638.134079:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643145728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784638.134085:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784638.134114:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784638.134155:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784638.134192:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784638.134205:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318690ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784638.134216:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145856 00000100:00100000:1.0:1787784638.134220:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145856 00000100:00100000:1.0:1787784638.134241:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784638.134247:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643145856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784638.134411:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+12:14413:x1874627643145856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784638.134417:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784638.134450:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643145856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787784638.135032:0:14893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787784638.135084:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787784638.135098:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784638.135107:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.135117:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784638.391021:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784639.415227:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787784639.927922:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784640.444854:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784641.460513:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784642.484741:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787784642.545841:0:15098:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787784642.545847:0:15098:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787784642.546025:0:15098:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff943186233000 00000020:01000004:3.0:1787784642.546045:0:15098:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787784642.546058:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787784642.546074:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9431908fcd28) 00000020:00000080:3.0:1787784642.546103:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787784642.566804:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787784642.567669:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787784642.568633:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787784642.568847:0:15098:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787784642.569201:0:15098:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787784642.569815:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787784642.569905:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787784642.570072:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787784642.570790:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 694: rc = 0 00100000:10000000:2.0:1787784642.571506:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 694: rc = 0 00100000:10000000:2.0:1787784642.571838:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 694: rc = 0 00100000:10000000:2.0:1787784642.572351:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 694: rc = 0 00100000:10000000:2.0:1787784642.572843:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 694: rc = 0 00100000:10000000:2.0:1787784642.573316:0:15098:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 694: rc = 0 00000020:00000080:2.0:1787784642.574197:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787784642.574208:0:15098:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787784642.574219:0:15098:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20bbac2 00000020:01000004:2.0:1787784642.574228:0:15098:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787784642.574321:0:15098:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787784642.574325:0:15098:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787784642.574331:0:15098:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787784642.574335:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787784642.574347:0:15098:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9431b9ecb370) 00000020:00000080:2.0:1787784642.574358:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787784642.575936:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784642.576142:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784642.576148:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787784642.582618:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784642.582634:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787784642.583711:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784642.583718:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787784642.587707:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787784642.587892:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787784642.587898:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787784642.589916:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784642.589931:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787784642.639782:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787784642.640050:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787784642.640058:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787784642.642452:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787784642.642467:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787784642.643952:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787784642.643963:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787784642.647763:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784642.649205:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784642.649219:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787784642.650238:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787784642.650250:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787784642.692885:0:15098:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787784642.693325:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787784642.693334:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787784642.701710:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787784642.701727:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787784642.702853:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787784642.702879:0:15098:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787784642.702886:0:15098:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787784642.720056:0:15098:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787784642.720109:0:15098:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787784642.720113:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787784642.720115:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784642.720116:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784642.720117:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784642.720118:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784642.720120:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784642.720121:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784642.720123:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784642.720124:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784642.720128:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787784642.720130:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784642.720131:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784642.720132:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784642.720133:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784642.720135:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784642.720136:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784642.720137:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784642.720138:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784642.720139:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784642.720172:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787784642.720193:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643145984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784642.720267:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784642.720341:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190a2aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.720404:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643145984 00000100:00100000:2.0:1787784642.720412:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643145984 00000100:00100000:2.0:1787784642.720468:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784642.720477:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:15098:x1874627643145984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784642.720516:0:14411:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787784642.720520:0:14411:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787784642.720523:0:14411:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787784642.737104:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:15098:x1874627643145984:12345-0@lo:253:mount.lustre.0 Request processed in 16619us (16827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.737119:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787784642.737228:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643145984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784642.737244:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787784642.737248:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784642.737249:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784642.737251:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784642.737252:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784642.737253:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784642.737255:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784642.737256:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784642.737258:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784642.737260:0:15098:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787784642.737283:0:15098:0:(tgt_mount.c:101:server_register_mount()) register mount ffff943186233000 from lustre-OST0000 10000000:01000000:2.0:1787784642.737317:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787784642.737321:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787784642.737327:0:15098:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431908f99b8 local copy 00010000:00010000:2.0:1787784642.737339:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.737646:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784642.737682:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.737721:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787784642.737839:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146112 00000100:00100000:3.0:1787784642.737845:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146112 00000100:00100000:3.0:1787784642.737878:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787784642.737886:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:15098:x1874627643146112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784642.738038:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+12:15098:x1874627643146112:12345-0@lo:501:mount.lustre.0 Request processed in 152us (354us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784642.738045:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787784642.738307:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146112:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787784642.738322:0:15098:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787784642.738503:0:15098:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787784642.738511:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.738530:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784642.738553:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff943186233000 10000000:01000000:2.0:1787784642.738565:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787784642.738570:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9431908f99b8 10000000:01000000:2.0:1787784642.738572:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787784642.738575:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9431908f99b8 from 1 10000000:01000000:2.0:1787784642.738578:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787784642.738603:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.738611:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.738619:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.738632:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784642.738662:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.738689:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784642.738926:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146240 00000100:00100000:1.0:1787784642.738931:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146240 00000100:00100000:1.0:1787784642.738987:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787784642.738995:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+12:15098:x1874627643146240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784642.739005:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784642.739017:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d0800/0xffb8d925c20bbad7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbad0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784642.739038:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d0800/0xffb8d925c20bbad7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbad0 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784642.739047:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d0800/0xffb8d925c20bbad7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbad0 expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784642.739055:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0800, rc 0) 00000100:00100000:1.0:1787784642.739098:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+13:15098:x1874627643146240:12345-0@lo:101:mount.lustre.0 Request processed in 104us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.739104:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787784642.739832:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784642.739848:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.739858:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784642.739875:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787784642.739892:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.739900:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf500000/0xffb8d925c20bbad0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbad7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784642.739922:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787784642.739925:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784642.739930:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787784642.739933:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787784642.739953:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.739960:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.739968:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.739993:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784642.740026:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.740060:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.740129:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146368 00000100:00100000:0.0:1787784642.740135:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146368 00000100:00100000:0.0:1787784642.740172:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787784642.740180:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+13:15098:x1874627643146368:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784642.740189:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784642.740199:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bbae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbade expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.740215:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbade expref: 14 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.740224:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88a00/0xffb8d925c20bbae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbade expref: 14 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.740231:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88a00, rc 0) 00000100:00100000:0.0:1787784642.740273:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146368:12345-0@lo:101:mount.lustre.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.740279:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787784642.740400:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784642.740411:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.740419:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784642.741135:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787784642.742012:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784642.742287:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787784642.742331:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787784642.742361:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787784642.742459:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787784642.742495:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787784642.742543:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787784642.742606:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787784642.742614:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787784642.742692:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784642.742756:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.742794:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.743765:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146496 00000100:00100000:0.0:1787784642.743778:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146496 00000100:00100000:0.0:1787784642.743836:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787784642.743845:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784642.744263:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146496:12345-0@lo:501:mount.lustre.0 Request processed in 418us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.744271:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787784642.744663:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784642.744714:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784642.744761:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.744798:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.744825:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146624 00000100:00100000:2.0:1787784642.744831:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146624 00000100:00100000:2.0:1787784642.744870:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787784642.744879:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784642.746533:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146624:12345-0@lo:503:mount.lustre.0 Request processed in 1647us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.746546:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787784642.747608:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146624:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784642.748257:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784642.748341:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784642.748467:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.748502:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431867aaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.748644:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146752 00000100:00100000:0.0:1787784642.748658:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146752 00000100:00100000:0.0:1787784642.748709:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787784642.748718:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784642.748958:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146752:12345-0@lo:502:mount.lustre.0 Request processed in 241us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.748966:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787784642.749236:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784642.749768:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787784642.749831:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787784642.749868:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787784642.749934:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787784642.750010:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787784642.750047:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787784642.750096:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787784642.751517:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787784642.751575:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787784642.751626:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787784642.751655:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787784642.751691:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787784642.751740:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784642.751819:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.751866:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591300 going to sleep for 11 seconds 00000100:00100000:1.0:1787784642.752071:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643146880 00000100:00100000:1.0:1787784642.752080:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643146880 00000100:00100000:1.0:1787784642.752140:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787784642.752149:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784642.752467:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643146880:12345-0@lo:502:mount.lustre.0 Request processed in 319us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.752475:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787784642.753952:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643146880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784642.754129:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787784642.754146:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787784642.765213:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784642.765226:0:15112:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787784642.765233:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.765236:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787784642.765243:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784642.765260:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9431885e3370) 00000020:00000080:0.0:1787784642.765284:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787784642.765289:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784642.765389:0:15112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943186233000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787784642.765398:0:15112:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784642.765405:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xffb8d925c20bbaf3 00010000:00010000:0.0:1787784642.771681:0:15112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787784642.773520:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787784642.779513:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787784642.791420:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787784642.791435:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784642.791442:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791445:0:15112:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787784642.791449:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787784642.791452:0:15112:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787784642.791454:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784642.791456:0:15112:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787784642.791457:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787784642.791460:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791461:0:15112:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787784642.791471:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784642.791475:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791477:0:15112:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787784642.791480:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787784642.791482:0:15112:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787784642.791485:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784642.791488:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791489:0:15112:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787784642.791491:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787784642.791493:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791495:0:15112:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787784642.791499:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787784642.791566:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787784642.791570:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784642.791572:0:15112:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787784642.791575:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787784642.791788:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787784642.791816:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787784642.791841:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.791853:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf501a00/0xffb8d925c20bbade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbae5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784642.791862:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943186233000 from 1 10000000:01000000:2.0:1787784642.791865:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784642.791901:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.791910:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.791932:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.791957:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784642.792039:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.792078:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591900 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.792448:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147008 00000100:00100000:0.0:1787784642.792457:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147008 00000100:00100000:0.0:1787784642.792500:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787784642.792510:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+14:15098:x1874627643147008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787784642.792526:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784642.792540:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbafa expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.792562:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 15 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.792573:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 15 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.792581:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88800, rc 0) 00000100:00100000:0.0:1787784642.792625:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147008:12345-0@lo:101:mount.lustre.0 Request processed in 117us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.792639:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787784642.796140:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784642.796171:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.796184:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784642.796782:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787784642.797106:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784642.797354:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787784642.797442:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787784642.797504:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787784642.797512:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787784642.797579:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784642.797645:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.797696:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.797842:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147136 00000100:00100000:2.0:1787784642.797848:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147136 00000100:00100000:2.0:1787784642.797896:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787784642.797910:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784642.798117:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147136:12345-0@lo:501:mount.lustre.0 Request processed in 212us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.798125:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787784642.798394:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784642.798428:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784642.798468:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.798495:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431907cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.798505:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147264 00000100:00100000:0.0:1787784642.798509:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147264 00000100:00100000:0.0:1787784642.798544:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787784642.798551:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784642.798694:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147264:12345-0@lo:503:mount.lustre.0 Request processed in 143us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.798700:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787784642.799196:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784642.799740:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784642.799798:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784642.799842:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.799876:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431867aaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784642.799967:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147392 00000100:00100000:1.0:1787784642.799981:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147392 00000100:00100000:1.0:1787784642.800019:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787784642.800028:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784642.800253:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147392:12345-0@lo:502:mount.lustre.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.800260:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787784642.800415:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784642.800640:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787784642.800686:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787784642.800726:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787784642.800756:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787784642.800783:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787784642.800841:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787784642.800874:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787784642.800901:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787784642.800926:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba258b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784642.800966:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.801007:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591480 going to sleep for 11 seconds 00000100:00100000:1.0:1787784642.801022:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147520 00000100:00100000:1.0:1787784642.801027:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147520 00000100:00100000:1.0:1787784642.801063:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787784642.801071:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784642.801263:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147520:12345-0@lo:502:mount.lustre.0 Request processed in 192us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784642.801338:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787784642.801460:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba258b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784642.801534:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787784642.801543:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787784642.804083:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784642.804097:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.804210:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784642.804221:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943186233000 00000020:00000080:3.0:1787784642.804224:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784642.804233:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784642.804235:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.804236:0:15116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784642.804239:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784642.804255:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.804256:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784642.804259:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff943186233000 00000020:00000080:3.0:1787784642.804261:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784642.805344:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784642.805353:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.805355:0:15116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784642.805359:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784642.805383:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.805385:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784642.805390:0:15116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff943186233000 00000020:00000080:3.0:1787784642.805392:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784642.805456:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784642.805460:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784642.805461:0:15116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784642.805465:0:15116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787784642.805722:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787784642.805764:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784642.805786:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.805798:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784642.805847:0:15098:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784642.805850:0:15098:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff943186233000 10000000:01000000:2.0:1787784642.805853:0:15098:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff943186233000 10000000:01000000:2.0:1787784642.805857:0:15098:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784642.805862:0:15098:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff943186233000 from 1 10000000:01000000:2.0:1787784642.805865:0:15098:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784642.805900:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.805908:0:15098:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.805919:0:15098:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.805954:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784642.806231:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.806441:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147648 00000100:00100000:3.0:1787784642.806449:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147648 00000100:00100000:2.0:1787784642.806598:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784642.806650:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787784642.806661:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643147648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784642.806674:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784642.806687:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185611200/0xffb8d925c20bbb0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbb08 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.806709:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185611200/0xffb8d925c20bbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbb08 expref: 16 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.806721:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185611200/0xffb8d925c20bbb0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbb08 expref: 16 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.806730:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185611200, rc 0) 00000100:00100000:3.0:1787784642.806778:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643147648:12345-0@lo:101:mount.lustre.0 Request processed in 120us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784642.806794:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787784642.806870:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784642.806885:0:15098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.806895:0:15098:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784642.807539:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787784642.808297:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784642.808631:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787784642.808689:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787784642.808726:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787784642.808767:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787784642.808797:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787784642.808843:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787784642.808877:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787784642.808902:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787784642.808950:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787784642.808998:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787784642.809027:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787784642.809066:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787784642.809093:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787784642.809119:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787784642.809171:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787784642.809205:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787784642.809232:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787784642.809280:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787784642.809308:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787784642.809333:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787784642.809393:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787784642.809424:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787784642.809449:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787784642.809486:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787784642.809519:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787784642.809552:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787784642.809595:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787784642.809623:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787784642.809683:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787784642.809695:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787784642.809781:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784642.809843:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784642.814347:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147776 00000100:00100000:0.0:1787784642.814360:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147776 00000100:00100000:0.0:1787784642.814426:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787784642.814436:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643147776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784642.814738:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643147776:12345-0@lo:501:mount.lustre.0 Request processed in 303us (4894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.814746:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787784642.815122:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.815244:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784642.815301:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784642.815346:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.815444:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784642.815575:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643147904 00000100:00100000:0.0:1787784642.815581:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643147904 00000100:00100000:0.0:1787784642.815643:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787784642.815651:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643147904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787784642.815908:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643147904:12345-0@lo:503:mount.lustre.0 Request processed in 257us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.815915:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787784642.815994:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643147904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784642.816783:0:15098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784642.816868:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784642.816924:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784642.817378:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148032 00000100:00100000:3.0:1787784642.817386:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148032 00000100:00100000:3.0:1787784642.817421:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787784642.817429:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643148032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784642.817647:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643148032:12345-0@lo:502:mount.lustre.0 Request processed in 219us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784642.817654:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787784642.817915:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.817935:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784642.818283:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787784642.818344:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787784642.818620:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787784642.818671:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787784642.818704:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787784642.818752:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787784642.818868:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787784642.818906:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787784642.818955:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787784642.819001:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787784642.819034:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787784642.819080:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787784642.819116:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787784642.819219:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787784642.819263:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787784642.819297:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787784642.819331:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787784642.820931:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787784642.821012:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787784642.821049:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787784642.821099:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787784642.821565:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787784642.821611:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787784642.821662:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787784642.821696:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787784642.821726:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787784642.821867:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787784642.821907:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787784642.821940:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787784642.822001:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787784642.822038:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787784642.822072:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787784642.822100:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787784642.825420:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787784642.826217:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787784642.826294:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787784642.826331:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787784642.826400:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787784642.826472:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787784642.827116:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787784642.827182:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784642.827265:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.827308:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431b4591540 going to sleep for 11 seconds 00000100:00100000:3.0:1787784642.827911:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148160 00000100:00100000:3.0:1787784642.827919:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148160 00000100:00100000:3.0:1787784642.827984:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787784642.827995:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643148160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784642.828230:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643148160:12345-0@lo:502:mount.lustre.0 Request processed in 237us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784642.828239:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787784642.829349:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784642.829484:0:15098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787784642.829498:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787784642.830676:0:15119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787784642.830693:0:15119:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9431885e4d28) 00000020:00000080:0.0:1787784642.830715:0:15119:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787784642.830805:0:15119:0:(tgt_mount.c:153:server_get_mount()) get mount ffff943186233000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784642.830816:0:15119:0:(tgt_mount.c:187:server_put_mount()) put mount ffff943186233000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787784642.830819:0:15119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff943186233000 3 00010000:00080000:0.0:1787784642.830855:0:15119:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431bf6eb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1787784642.832508:0:15119:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787784642.832708:0:15119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787784642.832742:0:15119:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787784642.832757:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xffb8d925c20bbb1d 00000100:00080000:0.0:1787784642.832769:0:15119:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787784642.832776:0:15119:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9431bf6eb000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784642.832813:0:15119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45ac000 x1874627643148288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784642.832846:0:15119:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787784642.834182:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643148288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784642.834259:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787784642.835093:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784642.835100:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787784642.835102:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787784642.835106:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787784642.835172:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643148416:0@lo:400:kworker.0 00000100:00100000:2.0:1787784642.835214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.835261:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148288 00000100:00100000:2.0:1787784642.835267:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148288 00000100:00100000:2.0:1787784642.835295:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148416 00000100:00100000:2.0:1787784642.835298:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148416 00000100:00100000:2.0:1787784642.835327:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784642.835336:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643148416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784642.835407:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1874627643148416:12345-0@lo:400:kworker.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.835414:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784642.835431:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784642.835435:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3292:x1874627643148288:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784642.835455:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:2.0:1787784642.835492:0:14417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xffb8d925c20bbb24 00000004:00100000:2.0:1787784642.835507:0:14417:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784642.835538:0:14417:0:(import.c:65:import_set_state_nolock()) ffff943192073800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784642.835577:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1874627643148288:12345-0@lo:38:llog_process_th.0 Request processed in 139us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784642.835592:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787784642.835633:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431b45ac000 x1874627643148288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784642.835644:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784642.835651:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787784642.835659:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787784642.835663:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784642.835665:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431bf6eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784642.835671:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3292:1874627643148288:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784642.835791:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9431ba25b840 x1874627643148416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784642.835802:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3294:1874627643148416:0@lo:400:kworker.0 00000040:00080000:0.0:1787784642.841375:0:15119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787784642.843051:0:15098:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787784642.843089:0:15098:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787784642.843453:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784642.843467:0:15098:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf501000/0xffb8d925c20bbb08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb0f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787784642.843530:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787784642.843532:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784642.843534:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784642.843535:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784642.843536:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784642.843538:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784642.843539:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784642.843541:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784642.843542:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784642.843546:0:15098:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787784642.843548:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784642.843549:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787784642.843551:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784642.843552:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784642.843553:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784642.843554:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784642.843555:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784642.843556:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784642.843557:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787784642.843582:0:15098:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787784642.843602:0:15098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784642.843668:0:15098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.843698:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148544 00000100:00100000:2.0:1787784642.843706:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148544 00000100:00100000:1.0:1787784642.843708:0:15098:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787784642.843753:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784642.843763:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:15098:x1874627643148544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784642.843807:0:14410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787784642.843820:0:14410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787784642.890825:0:14410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787784642.890874:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787784642.892239:0:14431:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787784642.892248:0:14431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787784642.892269:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.892288:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 16 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.892317:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.892388:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 16 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784642.892405:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 16 pid: 14411 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784642.892420:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643148672:0@lo:104: 00000100:00100000:2.0:1787784642.892490:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784642.892540:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff94319747f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784642.892640:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148672 00000100:00100000:3.0:1787784642.892647:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148672 00000100:00100000:3.0:1787784642.892693:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784642.892703:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643148672:12345-0@lo:104: 00010000:00010000:3.0:1787784642.892715:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784642.892762:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787784642.892767:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643148672:12345-0@lo:104: Request processed in 66us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784642.892783:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787784642.892816:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643148672:0@lo:104: 00010000:00010000:3.0:1787784642.892832:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.892931:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784642.892938:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.892946:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88e00 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784642.892949:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.892957:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784642.892964:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784642.892980:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787784642.893047:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893059:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784642.893081:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893088:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee88e00/0xffb8d925c20bba91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bba98 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893104:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784642.893106:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784642.893108:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784642.893122:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643148800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784642.893152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784642.893195:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148800 00000100:00100000:0.0:1787784642.893199:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148800 00010000:00010000:0.0:1787784642.893216:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 17 pid: 14411 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784642.893237:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784642.893243:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+17:3295:x1874627643148800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784642.893252:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784642.893257:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 17 pid: 14411 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893268:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 17 pid: 14411 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893281:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610000/0xffb8d925c20bba98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bba91 expref: 17 pid: 14411 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893302:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893327:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787784642.893341:0:14403:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001433596s 00010000:00010000:0.0:1787784642.893345:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893351:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893358:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893382:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893387:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784642.893390:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893397:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893409:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893417:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784642.893450:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+16:3295:x1874627643148800:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784642.893457:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784642.893703:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643148800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787784642.893727:0:14431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893735:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784642.893741:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf501c00/0xffb8d925c20bbb2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784642.900172:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+15:15098:x1874627643148544:12345-0@lo:253:mount.lustre.0 Request processed in 56401us (56494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784642.900188:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787784642.900301:0:15098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15098:1874627643148544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787784642.900315:0:15098:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787784642.900318:0:15098:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787784642.900320:0:15098:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787784642.900322:0:15098:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784642.900323:0:15098:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784642.900324:0:15098:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784642.900326:0:15098:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784642.900327:0:15098:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784642.900329:0:15098:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784642.900330:0:15098:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787784642.900349:0:15098:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787784642.909138:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784642.909267:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787784642.909437:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784642.909625:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787784642.909750:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787784642.909932:0:15098:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787784642.910721:0:15098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787784642.953447:0:15098:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787784642.953456:0:15098:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787784642.953486:0:15098:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787784642.953544:0:15098:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787784642.953557:0:15098:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787784642.953586:0:15098:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787784643.512908:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787784644.277016:0:14413:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787784644.277026:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9431b9fc6000 from 7 10000000:01000000:3.0:1787784644.277034:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787784644.277081:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277093:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277118:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784644.277143:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643148928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787784644.277214:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784644.277268:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431843a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784644.277299:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643148928 00000100:00100000:3.0:1787784644.277306:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643148928 00000100:00100000:3.0:1787784644.277353:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787784644.277389:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+15:14413:x1874627643148928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784644.277403:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784644.277416:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbb32 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277440:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 16 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277452:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 16 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277460:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610200, rc 0) 00000100:00100000:3.0:1787784644.277498:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:14413:x1874627643148928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784644.277506:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787784644.277553:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643148928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784644.277567:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784644.277582:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784644.277888:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643149056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787784644.277921:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784644.277987:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431843a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784644.278234:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149056 00000100:00100000:0.0:1787784644.278239:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149056 00000100:00100000:0.0:1787784644.278313:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787784644.278323:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:14413:x1874627643149056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784644.278340:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784644.278358:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784644.278361:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787784644.278479:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:14413:x1874627643149056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784644.278487:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787784644.279127:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d27840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643149056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784644.279192:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784644.279201:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784644.279212:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784644.532698:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784645.563583:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784646.582965:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784647.604489:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784647.988737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784647.988745:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787784647.988748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784647.988767:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787784647.988833:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784647.988852:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643149184:0@lo:400:kworker.0 00000100:00100000:0.0:1787784647.988945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784647.989018:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149184 00000100:00100000:0.0:1787784647.989027:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149184 00000100:00100000:0.0:1787784647.989078:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784647.989088:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:3295:x1874627643149184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784647.989144:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:3295:x1874627643149184:12345-0@lo:400:kworker.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784647.989152:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787784647.989199:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643149184:0@lo:400:kworker.0 00000100:00100000:2.0:1787784647.989286:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643149312:0@lo:400:kworker.0 00000100:00100000:2.0:1787784647.989320:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784647.989383:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784647.989390:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643149440:0@lo:400:kworker.0 00000100:00100000:2.0:1787784647.989414:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784647.989740:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149312 00000100:00100000:2.0:1787784647.989745:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149312 00000100:00100000:2.0:1787784647.989774:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149440 00000100:00100000:2.0:1787784647.989777:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149440 00000100:00100000:2.0:1787784647.989813:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784647.989821:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643149312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784647.989862:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643149312:12345-0@lo:400:kworker.0 Request processed in 42us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784647.989869:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784647.989882:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784647.989889:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643149440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784647.989918:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643149440:12345-0@lo:400:kworker.0 Request processed in 30us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784647.989940:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784647.990024:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45ade00 x1874627643149440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784647.990037:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643149440:0@lo:400:kworker.0 00010000:00080000:2.0:1787784647.990135:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45ac3c0 x1874627643149312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784647.990146:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643149312:0@lo:400:kworker.0 00000100:00080000:0.0:1787784647.990444:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787784648.631152:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787784649.122618:0:15467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787784649.144806:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787784649.654088:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784650.676556:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784651.703501:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784652.086100:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784637/real 1787784637] req@ffff9431ba25bc00 x1874627643145344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784652.086146:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431ba25bc00 x1874627643145344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784652.086189:0:3292:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787784637/real 1787784637] req@ffff9431ba2592c0 x1874627643145472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784652 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784652.086204:0:3292:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9431ba2592c0 x1874627643145472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787784652 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784652.086229:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784652.086268:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784652.086273:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643145344:0@lo:8:kworker.0 00000100:00080000:2.0:1787784652.086280:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787784652.086286:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787784652.086289:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643145472:0@lo:8:kworker.0 00000100:00080000:0.0:1787784652.086514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784652.086520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787784652.086524:0:37:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784652.086529:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1787784652.086537:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784652.086547:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9431b42ba800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784652.086575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45ad2c0 x1874627643149696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787784652.086589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784652.086602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784652.086603:0:37:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784652.086607:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1787784652.086610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787784652.086613:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784652.086628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45acf00 x1874627643149824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784652.086692:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643149952:0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.086797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.086895:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784652.086902:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643149568:0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.086940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.086971:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643149696:0@lo:8:kworker.0 00000100:00100000:0.0:1787784652.087005:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.087024:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643149824:0@lo:8:kworker.0 00000100:00100000:0.0:1787784652.087047:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.087073:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643150080:0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.087105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.087146:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149952 00000100:00100000:0.0:1787784652.087155:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149952 00000100:00100000:0.0:1787784652.087211:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150080 00000100:00100000:0.0:1787784652.087215:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150080 00000100:00100000:0.0:1787784652.087246:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784652.087256:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643149952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.087314:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874627643149952:12345-0@lo:400:kworker.0 Request processed in 60us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.087331:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784652.087351:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784652.087357:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643150080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.087437:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643150080:12345-0@lo:400:kworker.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.087444:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784652.087463:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149568 00000100:00100000:0.0:1787784652.087467:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149568 00000100:00100000:0.0:1787784652.087494:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784652.087501:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:3296:x1874627643149568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784652.087531:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:3296:x1874627643149568:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.087538:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787784652.087583:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149696 00000100:00100000:0.0:1787784652.087586:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149696 00000100:00100000:0.0:1787784652.087601:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643149824 00000100:00100000:0.0:1787784652.087603:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643149824 00000100:00100000:0.0:1787784652.087614:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784652.087619:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643149696:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787784652.087648:0:15099:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:0.0:1787784652.087685:0:15099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bbb40 00002000:00100000:0.0:1787784652.087705:0:15099:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9431bf6ef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787784652.087710:0:15099:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787784652.087713:0:15099:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787784652.088163:0:15099:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784652.088194:0:15099:0:(import.c:65:import_set_state_nolock()) ffff9431bf6e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784652.088255:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643149696:12345-0@lo:8:kworker.0 Request processed in 634us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784652.088263:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784652.088280:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784652.088284:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643149824:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787784652.088295:0:15099:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787784652.088322:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3292:x1874627643149824:12345-0@lo:8:kworker.0 Request processed in 37us (1273us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784652.088328:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787784652.088358:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787784652.088424:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45ac3c0 x1874627643150080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784652.088441:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643150080:0@lo:400:kworker.0 00010000:00080000:0.0:1787784652.088477:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45ad2c0 x1874627643149696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784652.088486:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784652.088494:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787784652.088503:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787784652.088510:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787784652.088512:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431b42ba800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787784652.088640:0:14439:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787784652.088665:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1874627643150336:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787784652.088700:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784652.088721:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787784652.088741:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643150208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784652.088768:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784652.089120:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150336 00000100:00100000:2.0:1787784652.089126:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150336 00000100:00100000:2.0:1787784652.089174:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787784652.089183:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14439:x1874627643150336:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787784652.091712:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784652.094206:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643149568:0@lo:400:kworker.0 00010000:00080000:1.0:1787784652.094237:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45af840 x1874627643149952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784652.094251:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874627643149952:0@lo:400:kworker.0 00000100:00100000:3.0:1787784652.096580:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150208 00000100:00100000:3.0:1787784652.096602:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150208 00000100:00100000:3.0:1787784652.096673:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784652.096686:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874627643150208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784652.096740:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784652.096858:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1874627643150208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (8088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784652.096868:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787784652.099948:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b4b40 x1874627643150208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784652.099998:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643150208:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787784652.101149:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787784652.101169:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643149696:0@lo:8:kworker.0 00000100:00080000:0.0:1787784652.101207:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784652.101213:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784652.101217:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643149824:0@lo:8:kworker.0 00000004:00080000:0.0:1787784652.101982:0:14438:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787784652.102466:0:14438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 466929099322ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787784652.103282:0:15101:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787784652.103295:0:15101:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787784652.103303:0:15101:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787784652.133919:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.133940:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.133973:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.133978:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.133986:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134016:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134027:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134036:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134064:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.134084:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.134090:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134099:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.134104:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134114:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134137:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134145:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094d4ea1b/0xffb8d925c20bbb47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134177:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.134179:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.134182:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.134786:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.134794:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134806:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.134810:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.134815:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134826:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134836:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134844:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134867:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.134878:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.134883:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134919:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.134923:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134931:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134943:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134950:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bfc6b8e/0xffb8d925c20bbb4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.134964:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.134965:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.134967:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.135420:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.135427:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135437:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.135441:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.135447:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135457:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135472:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135481:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135498:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.135507:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.135513:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135521:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.135524:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135533:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135545:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135553:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4b97b4/0xffb8d925c20bbb55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.135568:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.135575:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.135578:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.136000:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.136007:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136016:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.136019:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.136023:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136033:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136041:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136048:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136062:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.136070:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.136074:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136080:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.136083:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136103:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136115:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136122:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070a1355e/0xffb8d925c20bbb5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136136:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.136138:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.136140:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.136581:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.136588:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136598:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.136602:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.136606:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136617:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136626:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136641:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136658:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.136668:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.136672:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136680:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.136683:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136691:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136703:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136711:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0c5f794/0xffb8d925c20bbb63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.136724:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.136726:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.136728:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.144241:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.144265:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144289:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.144294:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.144302:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144319:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144330:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144338:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144360:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.144407:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.144413:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144421:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.144426:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144448:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144476:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144484:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac51ee42/0xffb8d925c20bbb6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144507:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.144509:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.144510:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.144970:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.144978:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.144987:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.144990:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.144995:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145005:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145014:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145022:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145049:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.145058:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.145063:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145071:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.145074:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145083:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145093:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145099:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbb71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145114:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.145115:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.145117:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.145505:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.145511:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145521:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.145529:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.145533:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145543:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145552:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145559:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145571:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.145578:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.145582:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145588:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.145591:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145599:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145610:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145627:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de6ed564/0xffb8d925c20bbb78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.145640:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.145641:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.145643:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.146032:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.146038:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146048:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.146051:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.146056:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146066:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146074:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146082:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146096:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.146104:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.146113:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146120:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.146124:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146131:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146141:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146149:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f349d3/0xffb8d925c20bbb7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146161:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.146163:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.146164:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.146551:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.146557:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146566:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.146569:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.146574:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146594:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146603:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146610:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146623:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784652.146631:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.146634:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146640:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.146642:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146650:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146660:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146666:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030d9e398/0xffb8d925c20bbb86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.146687:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.146689:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.146690:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.149643:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.149666:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.149689:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.149694:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.149703:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.149719:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.149730:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.149738:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.149767:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.150344:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.150352:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.150411:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.150415:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.150420:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.150429:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150561:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784652.150570:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150579:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784652.150585:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150595:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150620:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150635:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a73fb56/0xffb8d925c20bbb8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.150663:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.150665:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.150668:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.151252:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.151262:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.151322:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.152053:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.152062:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.152077:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.152081:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.152088:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.152099:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.152123:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.152131:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.160377:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787784652.160398:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.160417:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784652.160422:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.160445:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.160473:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.160481:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003577e80b/0xffb8d925c20bbb94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.162504:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787784652.167698:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784652.167717:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.167745:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784652.167750:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.167764:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.167791:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.167800:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7f51c08/0xffb8d925c20bbb9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784652.167823:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.167825:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.167827:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.167833:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.167835:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.167837:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.172977:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.172994:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173016:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.173022:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.173030:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173046:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173058:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173067:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173111:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.173618:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.173625:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173636:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.173639:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.173644:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173653:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173662:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173670:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.173692:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787784652.174103:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.174109:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174118:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.174127:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.174132:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174143:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174152:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174160:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174168:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787784652.174572:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.174579:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174589:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.174592:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.174596:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174607:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174617:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174632:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.174642:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787784652.175055:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.175061:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175070:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.175073:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.175078:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175086:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175094:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175100:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175108:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787784652.175536:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.175543:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175557:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.175560:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.175566:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175575:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175585:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175594:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.175603:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1787784652.176162:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787784652.176174:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176185:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176198:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176209:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176235:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176243:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bbba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176268:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787784652.176272:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176279:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176283:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176291:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176301:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176307:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1682694/0xffb8d925c20bbba9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176329:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787784652.176333:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176339:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176342:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176350:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176359:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176383:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ccf08b/0xffb8d925c20bbbb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176396:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787784652.176400:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176405:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176408:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176426:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176452:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176460:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bbbb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176474:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784652.176477:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176483:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176486:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176493:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176503:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176510:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9147ee/0xffb8d925c20bbbbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176534:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784652.176537:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176545:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.176547:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176556:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176566:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176573:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf74b7c/0xffb8d925c20bbbc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.176585:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.176587:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.176589:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.178056:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.178074:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.178095:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.178100:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.178107:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.178121:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.178142:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.178150:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.178177:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784652.178609:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784652.178618:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.178628:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.178640:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.178649:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.178669:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.178676:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7c663c/0xffb8d925c20bbbcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.178699:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.178701:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.178703:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.180251:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.180266:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.180283:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1787784652.180288:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.180295:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.180309:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.180321:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.180329:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.180528:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.181667:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.181679:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.181696:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.181700:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.181707:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.181723:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.181734:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.181743:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184256:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784652.184276:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184293:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.184299:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184312:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184339:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184378:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba99aba/0xffb8d925c20bbbd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184580:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784652.184587:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184594:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784652.184597:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184605:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184616:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784652.184624:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.184626:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784652.184628:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784652.188548:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.194455:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787784652.194476:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bbbda lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784652.195337:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.195349:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195425:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.195431:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.195440:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195460:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195471:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195479:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195497:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.195942:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.195949:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195959:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.195963:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.195967:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195977:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.195999:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196006:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196014:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787784652.196444:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784652.196454:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196464:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.196470:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196482:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196505:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196515:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dcc81d/0xffb8d925c20bbbe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196536:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784652.196545:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196553:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784652.196557:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196566:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196576:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196584:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c76e7ec/0xffb8d925c20bbbe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196598:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.196599:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784652.196601:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784652.196684:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.196690:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196700:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.196704:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.196709:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196729:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196739:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196748:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.196767:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787784652.197215:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.197222:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197231:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.197234:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.197238:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197248:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197255:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197273:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197282:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787784652.197720:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784652.197727:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197737:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=467s v=(0 0) 00010000:00010000:2.0:1787784652.197740:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784652.197745:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197755:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197765:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197773:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784652.197782:0:15101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787784652.198088:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787784652.198098:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198106:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784652.198111:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198121:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198141:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198149:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e251c597/0xffb8d925c20bbbef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198170:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784652.198175:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198182:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784652.198185:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198207:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198218:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198225:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000546d915b/0xffb8d925c20bbbf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198238:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784652.198241:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198248:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784652.198251:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198257:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198266:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198273:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b60f191/0xffb8d925c20bbbfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784652.198296:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784652.198298:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784652.198300:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787784652.199078:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787784652.199568:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787784652.202077:0:15101:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787784652.204031:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14439:x1874627643150336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114833us (115314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784652.204062:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784652.210848:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1874627643150336:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784652.210877:0:14439:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787784652.211554:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1874627643150464:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787784652.211642:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784652.211699:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff943191868840 going to sleep for 11 seconds 00000100:00100000:3.0:1787784652.211812:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150464 00000100:00100000:3.0:1787784652.211820:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150464 00000100:00100000:3.0:1787784652.211882:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784652.211902:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14439:x1874627643150464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787784652.212094:0:15102:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787784652.228037:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14439:x1874627643150464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16121us (16380us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787784652.228060:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787784652.228699:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14439:1874627643150464:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787784652.228722:0:14439:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787784652.734412:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787784653.239855:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787784653.239894:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787784653.748760:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784654.773553:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784655.797427:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784656.820592:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784657.211553:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784657.211561:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784657.211565:0:38:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784657.211573:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1787784657.211578:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787784657.211585:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784657.211611:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45ae940 x1874627643150848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784657.211697:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643150592:0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.211788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784657.211850:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784657.211858:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643150720:0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.211887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784657.211921:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643150848:0@lo:8:kworker.0 00000100:00100000:0.0:1787784657.211944:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784657.211970:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643150976:0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.211996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784657.212015:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784657.212021:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643151104:0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.212042:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784657.212306:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150592 00000100:00100000:0.0:1787784657.212313:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150592 00000100:00100000:0.0:1787784657.212355:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784657.212385:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:3295:x1874627643150592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.212438:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:3295:x1874627643150592:12345-0@lo:400:kworker.0 Request processed in 75us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784657.212445:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787784657.212480:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150720 00000100:00100000:0.0:1787784657.212483:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150720 00000100:00100000:0.0:1787784657.212573:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150848 00000100:00100000:0.0:1787784657.212577:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150848 00000100:00100000:0.0:1787784657.212590:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784657.212596:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643150720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784657.212629:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643150720:12345-0@lo:400:kworker.0 Request processed in 34us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784657.212635:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787784657.212657:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784657.212661:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1874627643150848:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787784657.212679:0:15101:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787784657.216123:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643150976 00000100:00100000:2.0:1787784657.216141:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643150976 00000100:00100000:2.0:1787784657.216185:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151104 00000100:00100000:2.0:1787784657.216188:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151104 00000100:00100000:2.0:1787784657.216213:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784657.216223:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643150976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784657.216340:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643150976:12345-0@lo:400:kworker.0 Request processed in 118us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.216348:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787784657.216383:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784657.216391:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643151104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784657.216422:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643151104:12345-0@lo:400:kworker.0 Request processed in 33us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784657.216429:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787784657.216481:0:3295:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787784657.216502:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643150720:0@lo:400:kworker.0 00000100:00100000:2.0:1787784657.216515:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643150592:0@lo:400:kworker.0 00000100:00100000:1.0:1787784657.219551:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787784657.219574:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784657.219662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787784657.221899:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787784657.221910:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784657.227010:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151232 00000100:00100000:3.0:1787784657.227027:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151232 00000100:00100000:3.0:1787784657.227092:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784657.227104:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643151232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784657.227144:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1787784657.227513:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45aed00 x1874627643151104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784657.227530:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643151104:0@lo:400:kworker.0 00010000:00080000:1.0:1787784657.227545:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45acb40 x1874627643150976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787784657.227553:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643150976:0@lo:400:kworker.0 00000100:00100000:3.0:1787784657.228947:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643151232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1838us (9277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784657.228961:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787784657.229158:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784657.248922:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1874627643150848:12345-0@lo:8:kworker.0 Request processed in 36248us (36965us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787784657.248937:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787784657.248983:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784657.248989:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787784657.248994:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643150848:0@lo:8:kworker.0 00010000:00010000:3.0:1787784657.845582:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787784658.592813:0:15819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787784658.592817:0:15819:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787784658.592973:0:15819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9431b3c6d800 00000020:01000004:1.0:1787784658.592989:0:15819:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787784658.593003:0:15819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787784658.593018:0:15819:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9431b62619b8) 00000020:00000080:1.0:1787784658.593036:0:15819:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787784658.608328:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787784658.608677:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787784658.609358:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787784658.609654:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787784658.609854:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787784658.610194:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 223: rc = 0 00100000:10000000:1.0:1787784658.610278:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 223: rc = 0 00100000:10000000:1.0:1787784658.610354:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 223: rc = 0 00100000:10000000:1.0:1787784658.610929:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 436: rc = 0 00100000:10000000:1.0:1787784658.611161:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 436: rc = 0 00100000:10000000:1.0:1787784658.611550:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 436: rc = 0 00100000:10000000:1.0:1787784658.616195:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 436: rc = 0 00100000:10000000:1.0:1787784658.616509:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 436: rc = 0 00100000:10000000:1.0:1787784658.616754:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 436: rc = 0 00000020:00000080:1.0:1787784658.617395:0:15819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787784658.617408:0:15819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787784658.617419:0:15819:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20bbc0b 00000020:01000004:1.0:1787784658.617427:0:15819:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787784658.617448:0:15819:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787784658.617452:0:15819:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787784658.617458:0:15819:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787784658.617482:0:15819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787784658.617486:0:15819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787784658.633286:0:15819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787784658.633345:0:15819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.159@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787784658.633351:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787784658.633353:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784658.633354:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784658.633355:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784658.633356:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784658.633357:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784658.633359:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784658.633360:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784658.633362:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784658.633522:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787784658.633526:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787784658.633527:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784658.633529:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784658.633530:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784658.633531:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784658.633532:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784658.633533:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784658.633535:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784658.633543:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787784658.633575:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787784658.633599:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151360:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787784658.633669:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784658.633773:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431885c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784658.634246:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151360 00000100:00100000:2.0:1787784658.634254:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151360 00000100:00100000:2.0:1787784658.634316:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787784658.634328:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15819:x1874627643151360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787784658.634440:0:14408:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787784658.634445:0:14408:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787784658.634450:0:14408:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787784658.641892:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+16:15819:x1874627643151360:12345-0@lo:253:mount.lustre.0 Request processed in 7556us (8211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.641909:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787784658.642035:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787784658.642054:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787784658.642058:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787784658.642060:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787784658.642062:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787784658.642063:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787784658.642065:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787784658.642066:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787784658.642068:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787784658.642071:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787784658.642072:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787784658.642094:0:15819:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9431b3c6d800 from lustre-OST0001 10000000:01000000:1.0:1787784658.642127:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787784658.642130:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787784658.642138:0:15819:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9431908f99b8 local copy 00010000:00010000:1.0:1787784658.642150:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784658.642824:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784658.642885:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784658.642924:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186f9a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787784658.643005:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151488 00000100:00100000:0.0:1787784658.643012:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151488 00000100:00100000:0.0:1787784658.643064:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787784658.643075:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:15819:x1874627643151488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787784658.643356:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+16:15819:x1874627643151488:12345-0@lo:501:mount.lustre.0 Request processed in 282us (471us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787784658.643505:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151488:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787784658.643524:0:15819:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787784658.643763:0:15819:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787784658.643774:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.643785:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610400/0xffb8d925c20bb9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bb9bf expref: -99 pid: 14398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784658.643813:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9431b3c6d800 10000000:01000000:3.0:1787784658.643819:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787784658.643824:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787784658.643846:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787784658.643851:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787784658.643854:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787784658.643889:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.643899:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.643910:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784658.643930:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784658.643969:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.643994:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431861316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.644079:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151616 00000100:00100000:1.0:1787784658.644084:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151616 00000100:00100000:1.0:1787784658.644112:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787784658.644119:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643151616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787784658.644130:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784658.644153:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bbc19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbc12 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.644179:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bbc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbc12 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.644192:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431829d1a00/0xffb8d925c20bbc19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbc12 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.644202:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1a00, rc 0) 00000100:00100000:1.0:1787784658.644247:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643151616:12345-0@lo:101:mount.lustre.0 Request processed in 128us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.644254:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787784658.644328:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784658.644342:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.644352:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.644619:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:3.0:1787784658.645645:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787784658.646789:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784658.647068:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787784658.647115:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787784658.647149:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787784658.647204:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787784658.647243:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787784658.647279:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787784658.647344:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787784658.647353:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787784658.647848:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784658.647920:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.648014:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.648059:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151744 00000100:00100000:1.0:1787784658.648067:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151744 00000100:00100000:1.0:1787784658.648162:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787784658.648174:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643151744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787784658.648660:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643151744:12345-0@lo:501:mount.lustre.0 Request processed in 487us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.648668:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787784658.648824:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784658.648870:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784658.648910:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.649177:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.649239:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643151872 00000100:00100000:1.0:1787784658.649243:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643151872 00000100:00100000:1.0:1787784658.649265:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787784658.649272:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643151872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784658.649597:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643151872:12345-0@lo:503:mount.lustre.0 Request processed in 324us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.649604:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787784658.649733:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643151872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784658.650773:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784658.650880:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784658.650942:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.650977:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.651304:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152000 00000100:00100000:1.0:1787784658.651318:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152000 00000100:00100000:1.0:1787784658.651352:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787784658.651360:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643152000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784658.651603:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643152000:12345-0@lo:502:mount.lustre.0 Request processed in 243us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.651611:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787784658.651837:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784658.652094:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787784658.652142:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787784658.652173:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787784658.652232:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787784658.652274:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787784658.652316:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787784658.652982:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787784658.653034:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787784658.653090:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787784658.653137:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784658.653202:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.653242:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431856139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.653306:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152128 00000100:00100000:1.0:1787784658.653313:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152128 00000100:00100000:1.0:1787784658.653346:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787784658.653354:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643152128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784658.653566:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643152128:12345-0@lo:502:mount.lustre.0 Request processed in 213us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.653574:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787784658.653733:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784658.653803:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787784658.653812:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787784658.655040:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787784658.655050:0:15820:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787784658.655058:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787784658.655060:0:15820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787784658.655068:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787784658.655083:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9431885e19b8) 00000020:00000080:0.0:1787784658.655107:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787784658.655114:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787784658.655195:0:15820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b3c6d800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787784658.655204:0:15820:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787784658.655212:0:15820:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xffb8d925c20bbc27 00010000:00010000:2.0:1787784658.659796:0:15820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787784658.662206:0:15820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787784658.664336:0:15820:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787784658.666277:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787784658.666292:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784658.666300:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784658.666302:0:15820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787784658.666305:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784658.666309:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784658.666311:0:15820:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787784658.666314:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787784658.666316:0:15820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787784658.666318:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784658.666320:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784658.666322:0:15820:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787784658.666324:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787784658.666327:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784658.666328:0:15820:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787784658.666332:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787784658.666432:0:15820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787784658.666437:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787784658.666448:0:15820:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787784658.666453:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787784658.666793:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787784658.666825:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787784658.666858:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.666872:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610c00/0xffb8d925c20bbc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc19 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784658.666880:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b3c6d800 from 1 10000000:01000000:3.0:1787784658.666890:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787784658.666932:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.666941:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.666953:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784658.666981:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787784658.667053:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.667097:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186131240 going to sleep for 11 seconds 00000100:00100000:2.0:1787784658.667211:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152256 00000100:00100000:2.0:1787784658.667218:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152256 00000100:00100000:2.0:1787784658.667265:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787784658.667276:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+17:15819:x1874627643152256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787784658.667289:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784658.667301:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbc2e expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.667325:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.667334:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.667342:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501200, rc 0) 00000100:00100000:2.0:1787784658.667549:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152256:12345-0@lo:101:mount.lustre.0 Request processed in 274us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.667557:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787784658.667646:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784658.667661:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.667670:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784658.668219:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787784658.697264:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787784658.698190:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787784658.698249:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787784658.698313:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787784658.698321:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787784658.698459:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784658.698533:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.698585:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190377000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784658.703027:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152384 00000100:00100000:3.0:1787784658.703043:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152384 00000100:00100000:3.0:1787784658.703182:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787784658.703194:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152384:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784658.704030:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152384:12345-0@lo:501:mount.lustre.0 Request processed in 837us (5494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.704040:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787784658.705095:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787784658.705175:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787784658.705237:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.705286:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190377000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.705340:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152512 00000100:00100000:1.0:1787784658.705346:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152512 00000100:00100000:1.0:1787784658.705436:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787784658.705446:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431a559d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787784658.706157:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431a559d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152512:12345-0@lo:503:mount.lustre.0 Request processed in 711us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.706165:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787784658.706327:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152512:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787784658.706903:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787784658.707145:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787784658.707192:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.707226:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190377000 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.707486:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152640 00000100:00100000:1.0:1787784658.707491:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152640 00000100:00100000:1.0:1787784658.707526:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787784658.707534:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784658.707867:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152640:12345-0@lo:502:mount.lustre.0 Request processed in 333us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.707884:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787784658.708040:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba2592c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784658.708314:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787784658.708480:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787784658.708538:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787784658.708576:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787784658.708614:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787784658.708664:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787784658.708744:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787784658.708781:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787784658.708811:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784658.708868:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.708984:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186131540 going to sleep for 11 seconds 00000100:00100000:1.0:1787784658.709227:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152768 00000100:00100000:1.0:1787784658.709233:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152768 00000100:00100000:1.0:1787784658.709261:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787784658.709268:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787784658.709445:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2981850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152768:12345-0@lo:502:mount.lustre.0 Request processed in 177us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784658.709453:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787784658.709490:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784658.709624:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787784658.709634:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787784658.711554:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784658.711811:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.711814:0:15824:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787784658.711823:0:15824:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b3c6d800 00000020:00000080:3.0:1787784658.711834:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784658.711842:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784658.711845:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.711847:0:15824:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787784658.711850:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784658.711852:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.711854:0:15824:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787784658.711857:0:15824:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9431b3c6d800 00000020:00000080:3.0:1787784658.711860:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784658.712008:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784658.712013:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.712015:0:15824:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787784658.712018:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787784658.712026:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.712027:0:15824:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787784658.712032:0:15824:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9431b3c6d800 00000020:00000080:3.0:1787784658.712034:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787784658.712072:0:15824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787784658.712076:0:15824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787784658.712077:0:15824:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787784658.712080:0:15824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787784658.712224:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787784658.712252:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784658.712273:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.712284:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784658.712328:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787784658.712331:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9431b3c6d800 10000000:01000000:2.0:1787784658.712334:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9431b3c6d800 10000000:01000000:2.0:1787784658.712338:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787784658.712342:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9431b3c6d800 from 1 10000000:01000000:2.0:1787784658.712345:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787784658.712397:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.712406:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.712430:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784658.712458:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787784658.712522:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.712566:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190377000 going to sleep for 11 seconds 00000100:00100000:3.0:1787784658.712754:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643152896 00000100:00100000:3.0:1787784658.712761:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643152896 00000100:00100000:3.0:1787784658.712802:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784658.712810:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643152896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784658.712823:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784658.712847:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff943185610600/0xffb8d925c20bbc43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbc3c expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.712869:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff943185610600/0xffb8d925c20bbc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbc3c expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.713205:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff943185610600/0xffb8d925c20bbc43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbc3c expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.713216:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943185610600, rc 0) 00000100:00100000:3.0:1787784658.713261:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643152896:12345-0@lo:101:mount.lustre.0 Request processed in 452us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.713268:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787784658.713653:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba258780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643152896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787784658.713673:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.713730:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784658.715199:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787784658.716199:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784658.716610:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787784658.716656:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787784658.716691:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787784658.716737:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787784658.716770:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787784658.716814:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787784658.717276:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787784658.717315:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787784658.717493:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787784658.717533:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787784658.717565:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787784658.717611:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787784658.717659:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787784658.717691:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787784658.717738:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787784658.717773:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787784658.717804:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787784658.717990:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787784658.718029:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787784658.718063:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787784658.718111:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787784658.718148:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787784658.718180:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787784658.718227:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787784658.718258:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787784658.718287:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787784658.718344:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787784658.718472:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787784658.718524:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787784658.718573:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787784658.718605:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787784658.718636:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787784658.718667:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787784658.718713:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787784658.718750:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787784658.718794:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787784658.721139:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787784658.721303:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787784658.721311:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787784658.721485:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784658.721549:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.721683:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431861316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784658.722437:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153024 00000100:00100000:3.0:1787784658.722445:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153024 00000100:00100000:3.0:1787784658.722490:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784658.722498:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784658.722725:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2980450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153024:12345-0@lo:501:mount.lustre.0 Request processed in 227us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.722733:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787784658.722781:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787784658.722814:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784658.722870:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.722893:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153152 00000100:00100000:3.0:1787784658.722896:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153152 00000100:00100000:3.0:1787784658.722999:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784658.723006:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153152:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787784658.723285:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2982850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153152:12345-0@lo:503:mount.lustre.0 Request processed in 278us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.723291:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787784658.723323:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431861316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784658.723335:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153152:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787784658.723855:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787784658.723991:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784658.724037:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.724074:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153280 00000100:00100000:3.0:1787784658.724079:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153280 00000100:00100000:3.0:1787784658.724105:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784658.724112:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784658.724313:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153280:12345-0@lo:502:mount.lustre.0 Request processed in 202us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.724320:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787784658.724353:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431861316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784658.724390:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787784658.724591:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787784658.724637:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787784658.724675:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787784658.724737:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787784658.724773:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787784658.724822:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787784658.724871:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787784658.724903:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787784658.725033:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787784658.725070:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787784658.725105:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787784658.725167:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787784658.725288:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787784658.725322:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787784658.725430:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787784658.725467:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787784658.725497:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787784658.725548:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787784658.725585:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787784658.725633:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787784658.725682:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787784658.725718:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787784658.725753:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787784658.725799:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787784658.725870:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787784658.726026:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787784658.726121:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787784658.726157:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787784658.726188:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787784658.726236:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787784658.726272:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787784658.726305:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787784658.726336:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787784658.726405:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787784658.726441:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787784658.726502:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787784658.726537:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787784658.726569:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787784658.726613:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787784658.726648:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787784658.726699:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787784658.726784:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.726841:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431861316c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784658.727292:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153408 00000100:00100000:0.0:1787784658.727298:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153408 00000100:00100000:0.0:1787784658.727343:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787784658.727352:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787784658.727660:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643153408:12345-0@lo:502:mount.lustre.0 Request processed in 309us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.727668:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787784658.728573:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643153408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787784658.728666:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787784658.728678:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787784658.734121:0:15828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787784658.734139:0:15828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9431b6263370) 00000020:00000080:1.0:1787784658.734160:0:15828:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787784658.736129:0:15828:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9431b3c6d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784658.736138:0:15828:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9431b3c6d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787784658.736141:0:15828:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9431b3c6d800 3 00010000:00080000:1.0:1787784658.736178:0:15828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9431857db800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1787784658.749787:0:15828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787784658.754235:0:15828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787784658.754282:0:15828:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787784658.754296:0:15828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xffb8d925c20bbc51 00000100:00080000:1.0:1787784658.754310:0:15828:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787784658.754316:0:15828:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9431857db800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1787784658.754443:0:15828:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45b61c0 x1874627643153536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787784658.754473:0:15828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787784658.754839:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643153536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787784658.755226:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.756173:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153536 00000100:00100000:2.0:1787784658.756182:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153536 00000100:00100000:2.0:1787784658.756223:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784658.756231:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1874627643153536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787784658.756258:0:14415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1787784658.756295:0:14415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xffb8d925c20bbc58 00000004:00100000:2.0:1787784658.756311:0:14415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787784658.756347:0:14415:0:(import.c:65:import_set_state_nolock()) ffff9431bee34000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784658.757260:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1874627643153536:12345-0@lo:38:llog_process_th.0 Request processed in 1026us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.757269:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784658.757327:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45b61c0 x1874627643153536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787784668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784658.757340:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787784658.757350:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787784658.757358:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787784658.759286:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784658.759292:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784658.759296:0:475:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784658.759304:0:475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1787784658.759309:0:475:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787784658.759316:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784658.759339:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b45acb40 x1874627643153792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784658.759414:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643153664:0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.759526:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643153920:0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.759575:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784658.759581:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643154048:0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759604:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.759638:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153664 00000100:00100000:0.0:1787784658.759653:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153664 00000100:00100000:0.0:1787784658.759696:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784658.759704:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643153664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759752:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45afc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643153664:12345-0@lo:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.759758:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787784658.759778:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153920 00000100:00100000:0.0:1787784658.759782:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153920 00000100:00100000:0.0:1787784658.759804:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154048 00000100:00100000:0.0:1787784658.759807:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154048 00000100:00100000:0.0:1787784658.759821:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784658.759840:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643153920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759875:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643153920:12345-0@lo:400:kworker.0 Request processed in 48us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.759881:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784658.759892:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784658.759899:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94318a55f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643154048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784658.759995:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94318a55f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1874627643154048:12345-0@lo:400:kworker.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784658.760001:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784658.760043:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643153664:0@lo:400:kworker.0 00010000:00080000:0.0:1787784658.760082:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45ada40 x1874627643154048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784658.760092:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3293:1874627643154048:0@lo:400:kworker.0 00010000:00080000:0.0:1787784658.760102:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9431b45aed00 x1874627643153920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787784658.760125:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643153920:0@lo:400:kworker.0 00000040:00080000:1.0:1787784658.760493:0:15828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1787784658.761161:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787784658.761166:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9431857db800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787784658.761175:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3292:1874627643153536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787784658.761199:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643153792:0@lo:8:kworker.0 00000100:00100000:2.0:1787784658.761246:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787784658.761282:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787784658.761311:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787784658.761324:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.761334:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf500a00/0xffb8d925c20bbc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc43 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787784658.761395:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787784658.761397:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784658.761398:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784658.761399:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784658.761401:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784658.761402:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784658.761403:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784658.761405:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784658.761406:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784658.761410:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787784658.761412:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787784658.761413:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787784658.761414:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787784658.761415:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787784658.761416:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787784658.761417:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787784658.761418:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787784658.761419:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787784658.761420:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787784658.761448:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787784658.761462:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431ba25a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643154176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787784658.761491:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784658.761522:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186ee3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784658.763032:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643153792 00000100:00100000:0.0:1787784658.763043:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643153792 00000100:00100000:0.0:1787784658.763077:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784658.763084:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1874627643153792:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787784658.763161:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3292:x1874627643153792:12345-0@lo:8:kworker.0 Request processed in 76us (1914us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787784658.763168:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784658.763218:0:3292:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787784658.763225:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787784658.763229:0:3292:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787784658.763232:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643153792:0@lo:8:kworker.0 00000100:00100000:3.0:1787784658.765078:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154176 00000100:00100000:3.0:1787784658.765092:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154176 00000100:00100000:3.0:1787784658.765138:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787784658.765147:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:15819:x1874627643154176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787784658.765179:0:14410:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787784658.765192:0:14410:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787784658.868535:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1787784658.875910:0:14410:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787784658.876107:0:14410:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787784658.880893:0:14431:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787784658.880905:0:14431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787784658.880939:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.880958:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.880968:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.881020:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784658.881035:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 19 pid: 14411 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.881070:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94318a55f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643154304:0@lo:104: 00000100:00100000:0.0:1787784658.881139:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784658.881354:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318636b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787784658.881709:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154304 00000100:00100000:2.0:1787784658.881718:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154304 00000100:00100000:2.0:1787784658.881771:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784658.881782:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643154304:12345-0@lo:104: 00010000:00010000:2.0:1787784658.881794:0:14400:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784658.881870:0:14400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787784658.881876:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:459db144-24ce-4979-944c-65e392f5ff2a+3:14431:x1874627643154304:12345-0@lo:104: Request processed in 97us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.881884:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784658.882019:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94318a55f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14431:1874627643154304:0@lo:104: 00010000:00010000:1.0:1787784658.882042:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882289:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787784658.882297:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882305:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:3.0:1787784658.882309:0:14405:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882317:0:14405:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787784658.882324:0:14405:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787784658.882330:0:14405:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787784658.882390:0:14405:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882397:0:14405:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787784658.882422:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882444:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185611000/0xffb8d925c20bbb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb39 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882462:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784658.882464:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784658.882466:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784658.882560:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787784658.882573:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643154432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787784658.882609:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784658.882720:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154432 00000100:00100000:3.0:1787784658.882725:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154432 00010000:00010000:3.0:1787784658.882747:0:14403:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 20 pid: 14411 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784658.882775:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787784658.882782:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+20:3296:x1874627643154432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784658.882793:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784658.882798:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 20 pid: 14411 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882809:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 20 pid: 14411 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882836:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff943185610200/0xffb8d925c20bbb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bbb32 expref: 20 pid: 14411 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882850:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882858:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787784658.882883:0:14403:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001979507s 00010000:00010000:3.0:1787784658.882888:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882895:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882901:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.882909:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.883070:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784658.883075:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.883083:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.883100:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784658.883110:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784658.883146:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643154432:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784658.883153:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787784658.883211:0:14431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.883219:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784658.883225:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbc5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784658.883334:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643154432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784658.888964:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2982c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:15819:x1874627643154176:12345-0@lo:253:mount.lustre.0 Request processed in 123810us (127462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784658.888980:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787784658.889265:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431ba25a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:459db144-24ce-4979-944c-65e392f5ff2a:15819:1874627643154176:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787784658.889282:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787784658.889285:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787784658.889287:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787784658.889289:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787784658.889290:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787784658.889291:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787784658.889293:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787784658.889294:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787784658.889296:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787784658.889297:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787784658.889312:0:15819:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787784658.901668:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784658.901870:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784658.902346:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784658.902778:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787784658.902961:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787784658.903660:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787784658.920491:0:15819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787784658.978919:0:15819:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787784658.978944:0:15819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787784658.979020:0:15819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787784658.979121:0:15819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787784658.979151:0:15819:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787784658.979205:0:15819:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:1.0:1787784659.385200:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787784659.896468:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787784660.212742:0:14413:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787784660.212752:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9431b9fc6000 from 8 10000000:01000000:1.0:1787784660.212759:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787784660.212823:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784660.212838:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784660.212852:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784660.212881:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643154560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784660.212961:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784660.213056:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787784660.213545:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154560 00000100:00100000:2.0:1787784660.213554:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154560 00000100:00100000:2.0:1787784660.213658:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787784660.213669:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b2983050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643154560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784660.213687:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784660.213710:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf501400/0xffb8d925c20bbc6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbc66 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.213734:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf501400/0xffb8d925c20bbc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbc66 expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.213744:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf501400/0xffb8d925c20bbc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbc66 expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784660.213753:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501400, rc 0) 00000100:00100000:2.0:1787784660.213806:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b2983050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643154560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784660.213821:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787784660.213899:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643154560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784660.213920:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784660.213930:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784660.213980:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643154688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787784660.214012:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784660.216397:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787784660.216493:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154688 00000100:00100000:0.0:1787784660.216502:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154688 00000100:00100000:0.0:1787784660.216564:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787784660.216573:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643154688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787784660.216598:0:14411:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787784660.216616:0:14411:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787784660.216619:0:14411:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787784660.216724:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643154688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784660.216732:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787784660.216833:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643154688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787784660.216896:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787784660.216906:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784660.216916:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0000/0xffb8d925c20bbc66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbc6d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784660.918775:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784661.942211:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784662.324562:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643154816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784662.324705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784662.328249:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154816 00000100:00100000:1.0:1787784662.328264:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154816 00000100:00100000:1.0:1787784662.328341:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787784662.328352:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643154816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784662.328411:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784662.328494:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643154816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784662.328501:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787784662.328657:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784662.328703:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643154816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787784662.964783:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787784663.860609:0:475:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787784663.860615:0:475:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787784663.860619:0:475:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787784663.860631:0:475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff943190323000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1787784663.860654:0:475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9431b419a940 x1874627643155200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787784663.860722:0:3292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643155200:0@lo:8:kworker.0 00000100:00100000:0.0:1787784663.860797:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.860876:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643155328:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.860903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.860924:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784663.860930:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643155456:0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.860950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.860980:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155200 00000100:00100000:0.0:1787784663.861001:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155200 00000100:00100000:3.0:1787784663.861228:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b41992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643155072:0@lo:400:kworker.0 00000100:00100000:3.0:1787784663.861261:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784663.861286:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784663.861292:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643154944:0@lo:400:kworker.0 00000100:00100000:3.0:1787784663.861318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784663.861338:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643155584:0@lo:400:kworker.0 00000100:00100000:3.0:1787784663.861360:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784663.861448:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155072 00000100:00100000:0.0:1787784663.861453:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155072 00000100:00100000:0.0:1787784663.861496:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784663.861505:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643155072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784663.861566:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643155072:12345-0@lo:400:kworker.0 Request processed in 62us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.861573:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787784663.861588:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784663.861592:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3292:x1874627643155200:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787784663.861614:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:0.0:1787784663.861644:0:15102:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xffb8d925c20bbc74 00002000:00100000:0.0:1787784663.861658:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9431bea54800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113936 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787784663.861662:0:15102:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787784663.861665:0:15102:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787784663.862350:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b41992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643155072:0@lo:400:kworker.0 00002000:00080000:0.0:1787784663.863688:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784663.863727:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431bea56800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784663.863835:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b41983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1874627643155200:12345-0@lo:8:kworker.0 Request processed in 2239us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784663.863846:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787784663.864482:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419a940 x1874627643155200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787784688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787784663.864500:0:3292:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787784663.864508:0:3292:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787784663.864515:0:3292:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787784663.864518:0:3292:0:(import.c:65:import_set_state_nolock()) ffff943190323000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787784663.864547:0:3292:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787784663.864553:0:3292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3292:1874627643155200:0@lo:8:kworker.0 00000004:00080000:3.0:1787784663.864718:0:14441:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787784663.864740:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1874627643155840:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787784663.864800:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784663.864820:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318549d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787784663.865021:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155840 00000100:00100000:0.0:1787784663.865441:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155840 00000100:00100000:0.0:1787784663.865517:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787784663.865527:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14441:x1874627643155840:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787784663.865966:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784663.865979:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643155712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784663.866027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784663.866090:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155712 00000100:00100000:2.0:1787784663.866094:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155712 00000100:00100000:2.0:1787784663.866124:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787784663.866131:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643155712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787784663.866167:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787784663.866208:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1874627643155712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784663.866217:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787784663.866252:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff943081d24f00 x1874627643155712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784663.866269:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643155712:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787784663.866486:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784663.867090:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155328 00000100:00100000:2.0:1787784663.867098:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155328 00000100:00100000:2.0:1787784663.867125:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155456 00000100:00100000:2.0:1787784663.867129:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155456 00000100:00100000:2.0:1787784663.867158:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155584 00000100:00100000:2.0:1787784663.867162:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155584 00000100:00100000:2.0:1787784663.867178:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784663.867185:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643155328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784663.867247:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643155328:12345-0@lo:400:kworker.0 Request processed in 62us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784663.867253:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784663.867267:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784663.867273:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643155456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784663.867301:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643155456:12345-0@lo:400:kworker.0 Request processed in 29us (6350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784663.867306:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784663.867317:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784663.867322:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643155584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784663.867392:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643155584:12345-0@lo:400:kworker.0 Request processed in 42us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784663.867410:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787784663.867448:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b4198780 x1874627643155584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784663.867461:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643155584:0@lo:400:kworker.0 00000100:00080000:3.0:1787784663.867673:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787784663.868444:0:14440:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787784663.868862:0:14440:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 478695495793ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787784663.868908:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643154944 00000100:00100000:3.0:1787784663.868916:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643154944 00000100:00100000:3.0:1787784663.868954:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787784663.868962:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3294:x1874627643154944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787784663.869114:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3294:x1874627643154944:12345-0@lo:400:kworker.0 Request processed in 152us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784663.869121:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787784663.870147:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643154944:0@lo:400:kworker.0 00010000:00080000:2.0:1787784663.872565:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419ad00 x1874627643155456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784663.872583:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643155456:0@lo:400:kworker.0 00010000:00080000:2.0:1787784663.872595:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b419bc00 x1874627643155328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784663.872603:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643155328:0@lo:400:kworker.0 00002000:00080000:0.0:1787784663.881707:0:15102:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787784663.881719:0:15102:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787784663.881725:0:15102:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1787784663.901397:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784663.901411:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901432:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1787784663.901437:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784663.901444:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901463:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901472:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901480:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901499:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.901514:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.901520:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901526:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.901531:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901552:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901568:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901576:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddce4910/0xffb8d925c20bbc7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.901592:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.901594:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.901595:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784663.902136:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784663.902143:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902152:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1787784663.902156:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784663.902160:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902169:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902177:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902190:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902208:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.902218:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.902222:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902228:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.902231:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902238:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902248:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902255:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f623ae9/0xffb8d925c20bbc82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902267:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.902269:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.902270:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784663.902732:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784663.902746:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902757:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1787784663.902759:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784663.902764:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.902773:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903545:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903557:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903577:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.903589:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.903594:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903601:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.903605:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903613:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903639:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903647:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059ccc96b/0xffb8d925c20bbc89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.903664:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.903666:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.903668:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784663.909165:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784663.909189:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909212:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1787784663.909217:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784663.909225:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909242:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909255:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909263:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909415:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.909432:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.909438:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909447:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.909452:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909461:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909491:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909499:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e9efd45/0xffb8d925c20bbc90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.909526:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.909529:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.909530:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787784663.911952:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787784663.911968:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.911988:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=478s v=(0 0) 00010000:00010000:0.0:1787784663.912003:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787784663.912010:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.912025:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913236:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913248:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913268:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.913284:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.913290:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913297:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.913302:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913311:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913848:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913871:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014c8886c/0xffb8d925c20bbc97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.913895:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.913897:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.913899:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784663.923849:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784663.923862:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.923880:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787784663.923885:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784663.923893:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.923908:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.923932:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.923939:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.923960:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.924226:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.924234:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.924244:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.924248:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.924257:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.924275:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.924282:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de6ed564/0xffb8d925c20bbc9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.924302:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.924304:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.924306:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787784663.927730:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787784663.927746:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.927766:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787784663.927771:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784663.927778:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.927804:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.927815:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.927823:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.927855:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784663.930491:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784663.930505:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.930520:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784663.930524:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.930534:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.930564:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.930571:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f349d3/0xffb8d925c20bbca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.930596:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784663.930598:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784663.930599:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784663.934525:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.934540:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.934570:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.934575:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.934582:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.934598:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.934607:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.934615:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.934630:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787784663.935921:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.935933:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.935945:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.935949:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.935959:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.935979:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.935987:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6911ff/0xffb8d925c20bbcac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.936003:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.936005:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.936006:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784663.936625:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.936634:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.936646:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.936651:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.936657:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.936669:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.936692:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.936700:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.936789:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784663.937417:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.937424:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.937434:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.937437:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.937441:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.937451:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.937459:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.937467:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937684:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784663.937691:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937699:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.937704:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937723:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937737:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937745:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54c3ec4/0xffb8d925c20bbcb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937759:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.937762:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937768:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.937771:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937789:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937798:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.937806:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.937807:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.937813:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.942170:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784663.942185:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9f031f7/0xffb8d925c20bbcba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.943622:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784663.943907:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.943916:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.943934:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.943939:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.943946:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.943960:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.943971:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.943979:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944009:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784663.944486:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.944493:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944507:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.944510:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.944514:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944524:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944532:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944539:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944553:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787784663.944892:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.944898:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944906:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.944909:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.944913:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944922:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944942:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944949:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.944958:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787784663.945320:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.945326:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945333:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.945336:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.945340:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945362:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945393:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945399:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945417:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787784663.945818:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.945824:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945832:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.945835:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.945839:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945848:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945855:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945862:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.945869:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787784663.946257:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.946263:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946272:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.946281:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.946285:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946294:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946301:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946309:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946316:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787784663.946748:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.946754:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946762:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.946765:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.946768:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.946777:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947015:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787784663.947023:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947032:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947552:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947563:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947584:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947591:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae61bbc7/0xffb8d925c20bbcc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947616:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787784663.947620:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947627:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947630:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947654:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947664:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947670:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000982b4502/0xffb8d925c20bbcc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947681:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787784663.947684:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947690:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947693:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947700:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947710:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947716:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c963a71/0xffb8d925c20bbccf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947738:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787784663.947742:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947748:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610e00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947750:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947756:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947766:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947773:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc685cf4/0xffb8d925c20bbcd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947795:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784663.947798:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947804:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185611c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947807:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947824:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947833:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947840:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000548e01a9/0xffb8d925c20bbcdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947852:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784663.947855:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947860:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269ea00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.947863:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947869:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947877:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947884:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ae15724/0xffb8d925c20bbce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.947905:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.947907:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.947909:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784663.948005:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.948180:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948196:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948254:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784663.948866:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.948874:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948888:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.948893:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.948901:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948914:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948923:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.948930:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784663.950653:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787784663.951511:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787784663.951527:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951543:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e800 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.951549:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951562:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951591:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951599:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005681f916/0xffb8d925c20bbceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951625:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784663.951629:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951636:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269f000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.951647:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951655:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951665:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.951672:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.951673:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.951675:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.959276:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784663.959292:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e627dd25/0xffb8d925c20bbcf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784663.961322:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784663.961445:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.962184:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.962202:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.962207:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.962214:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.962229:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.962239:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.962246:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.962275:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787784663.963210:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787784663.963220:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.963233:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269f400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784663.963238:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.963248:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.963269:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.963276:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084fd7657/0xffb8d925c20bbcf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784663.963307:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.963309:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784663.963312:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787784663.963970:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.963977:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.963988:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.963993:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.964004:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.964015:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.964022:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.965676:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.966112:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787784663.966923:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.966934:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.966952:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.966956:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.966964:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.966977:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.966987:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.967006:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973262:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784663.973275:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973290:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269fc00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.973294:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973306:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973599:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973609:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e19af9b/0xffb8d925c20bbd00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973629:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.973633:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973639:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.973642:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973664:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973674:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.973681:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.973683:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.973685:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.975252:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784663.975269:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf9ef8c/0xffb8d925c20bbd07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784663.977763:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.977775:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.977804:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.977808:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.977814:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.977827:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.977836:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.977843:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.980200:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.980215:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.980230:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.980235:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.980246:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.980268:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.980280:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.980282:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.980285:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.980567:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784663.980576:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067d281ef/0xffb8d925c20bbd0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784663.984760:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.984775:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.984806:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.984811:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.984818:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.984833:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.984843:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.984850:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.987478:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.987493:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.987507:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.987512:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.987522:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.987543:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.987557:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.987559:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784663.987561:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784663.988251:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784663.988262:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d06fd5c/0xffb8d925c20bbd15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784663.989005:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784663.989013:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.990264:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784663.990276:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784663.990288:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.990306:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.990317:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784663.990325:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.992205:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784663.992221:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.992235:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269fa00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784663.992240:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.992251:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784663.992296:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784663.992546:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784663.999465:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784663.999474:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784664.001247:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784664.001264:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e6d0eb/0xffb8d925c20bbd1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784664.001950:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787784664.001959:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784664.001984:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=478s v=(0 0) 00010000:00010000:3.0:1787784664.001989:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784664.001997:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784664.002011:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784664.002021:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784664.003197:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.003590:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784664.003604:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.003614:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784664.003619:0:14404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.003629:0:14404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.003647:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.003664:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.003670:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.003672:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.003673:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787784664.003732:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787784664.003738:0:15102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfac24a2/0xffb8d925c20bbd23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004173:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784664.004710:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784664.004718:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004731:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=478s v=(0 0) 00010000:00010000:1.0:1787784664.004735:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784664.004742:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004753:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004768:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004776:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.004811:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787784664.005233:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784664.005238:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005246:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=478s v=(0 0) 00010000:00010000:1.0:1787784664.005249:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784664.005253:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005262:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005270:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005277:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005302:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787784664.005313:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787784664.005317:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005324:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1200 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784664.005338:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005346:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005360:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005390:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c93b354/0xffb8d925c20bbd2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005405:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784664.005408:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005413:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784664.005416:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005433:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005442:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005448:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa141287/0xffb8d925c20bbd31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005460:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.005461:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.005463:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787784664.005861:0:15102:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787784664.005868:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005877:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=478s v=(0 0) 00010000:00010000:1.0:1787784664.005879:0:15102:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784664.005884:0:15102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005892:0:15102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005899:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005914:0:15102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005929:0:15102:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787784664.005936:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787784664.005940:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005947:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d0600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784664.005950:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005957:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005967:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005973:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d34b588e/0xffb8d925c20bbd38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784664.005985:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.005987:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784664.005988:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787784664.006151:0:15102:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787784664.006252:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14441:x1874627643155840:12345-0@lo:5:osp-pre-1-0.0 Request processed in 140722us (141448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784664.006267:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784664.006325:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1874627643155840:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787784664.006341:0:14441:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787784664.006409:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1874627643155968:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787784664.006443:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784664.006491:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff943190854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787784664.006508:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643155968 00000100:00100000:1.0:1787784664.006515:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643155968 00000100:00100000:1.0:1787784664.006555:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787784664.006563:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14441:x1874627643155968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787784664.006605:0:15099:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787784664.008313:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784664.013971:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14441:x1874627643155968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7396us (7514us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787784664.013988:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787784664.014219:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14441:1874627643155968:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787784664.014235:0:14441:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1787784664.523072:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787784664.523099:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787784665.012497:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787784666.038918:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784666.397945:0:16176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787784667.063556:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784667.447522:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643156096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784667.447659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784667.447806:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156096 00000100:00100000:0.0:1787784667.447816:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156096 00000100:00100000:0.0:1787784667.447881:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784667.447892:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643156096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787784667.447928:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784667.447978:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643156096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784667.447985:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787784667.448050:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784667.448233:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4199e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643156096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787784668.093087:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784668.982389:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156352:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.982483:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.982548:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643156864:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.982577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.982619:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784668.982624:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156480:0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.982651:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784668.983271:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156352 00000100:00100000:1.0:1787784668.983282:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156352 00000100:00100000:1.0:1787784668.983327:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156480 00000100:00100000:1.0:1787784668.983330:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156480 00000100:00100000:1.0:1787784668.983355:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784668.983390:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.983451:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643156352:12345-0@lo:400:kworker.0 Request processed in 88us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784668.983458:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787784668.983473:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787784668.983582:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643156480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784668.983612:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94318a55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643156480:12345-0@lo:400:kworker.0 Request processed in 32us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.983693:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643156608:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.983728:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.983762:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787784668.983769:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643156224:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.983794:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.983816:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643156736:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.983835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784668.983857:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156864 00000100:00100000:2.0:1787784668.983873:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156864 00000100:00100000:2.0:1787784668.983897:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156608 00000100:00100000:2.0:1787784668.983900:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156608 00000100:00100000:2.0:1787784668.983909:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156736 00000100:00100000:2.0:1787784668.983912:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156736 00000100:00100000:2.0:1787784668.983925:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784668.983930:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643156864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.983971:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1874627643156864:12345-0@lo:400:kworker.0 Request processed in 40us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.983977:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784668.983989:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784668.983995:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba259680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643156608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.984038:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba259680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643156608:12345-0@lo:400:kworker.0 Request processed in 43us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.984044:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787784668.984055:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784668.984061:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643156736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.984083:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643156736:12345-0@lo:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.984089:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787784668.984108:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156224 00000100:00100000:2.0:1787784668.984111:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156224 00000100:00100000:2.0:1787784668.984144:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784668.984151:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643156224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.984177:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9742450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643156224:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784668.984183:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787784668.984222:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643156224:0@lo:400:kworker.0 00010000:00080000:2.0:1787784668.984235:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b45b7840 x1874627643156736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784668.984246:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643156736:0@lo:400:kworker.0 00010000:00080000:2.0:1787784668.984255:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b45b4f00 x1874627643156608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784668.984264:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643156608:0@lo:400:kworker.0 00000100:00080000:2.0:1787784668.984310:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784668.984314:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784668.984343:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787784668.984354:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156480:0@lo:400:kworker.0 00000100:00100000:2.0:1787784668.984385:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156352:0@lo:400:kworker.0 00010000:00080000:2.0:1787784668.984396:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9431b45b61c0 x1874627643156864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787784684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787784668.984405:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b45b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3293:1874627643156864:0@lo:400:kworker.0 00000100:00100000:0.0:1787784668.991017:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784668.991039:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784668.991111:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784668.992427:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643156992 00000100:00100000:0.0:1787784668.992440:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643156992 00000100:00100000:0.0:1787784668.992509:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784668.992518:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643156992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784668.992554:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784668.992623:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643156992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784668.992629:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784668.992680:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643156992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784668.997441:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787784669.108581:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787784669.232557:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784669.232776:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767360 00000100:00100000:2.0:1787784669.232788:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767360 00000100:00100000:2.0:1787784669.232843:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:2.0:1787784669.232851:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2361:x1874627634767360:12345-192.168.202.59@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787784669.232880:0:14408:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 694b64e1-3991-40c4-9fdb-8a8fe572759c@192.168.202.59@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787784669.232911:0:14408:0:(genops.c:1385:class_connect()) connect: client 694b64e1-3991-40c4-9fdb-8a8fe572759c, cookie 0xffb8d925c20bbd3f 00000100:00080000:2.0:1787784669.233475:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9431bee32800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787784669.233550:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+5:2361:x1874627634767360:12345-192.168.202.59@tcp:250:mount.lustre.0 Request processed in 697us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784669.233559:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:1.0:1787784669.244819:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.245000:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767488 00000100:00100000:3.0:1787784669.245011:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767488 00000100:00100000:3.0:1787784669.245071:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1787784669.245081:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+5:13791:x1874627634767488:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784669.245116:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784669.245135:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269e200/0xffb8d925c20bbd46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ad33 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.245163:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269e200/0xffb8d925c20bbd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad33 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.245175:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269e200/0xffb8d925c20bbd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad33 expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.245184:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269e200, rc 0) 00000100:00100000:3.0:1787784669.245245:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9743850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+6:13791:x1874627634767488:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 166us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.245253:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:0.0:1787784669.261292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784669.261409:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767616 00000100:00100000:2.0:1787784669.261418:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767616 00000100:00100000:2.0:1787784669.261474:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:2.0:1787784669.261485:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+6:13791:x1874627634767616:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787784669.261912:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+6:13791:x1874627634767616:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 427us (677us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784669.261921:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:1.0:1787784669.268425:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.268532:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767744 00000100:00100000:3.0:1787784669.268543:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767744 00000100:00100000:3.0:1787784669.268657:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:3.0:1787784669.268666:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+6:13791:x1874627634767744:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784669.268683:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784669.268701:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269fa00/0xffb8d925c20bbd4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ad3a expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.268743:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269fa00/0xffb8d925c20bbd4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad3a expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.268755:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269fa00/0xffb8d925c20bbd4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad3a expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784669.268781:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269fa00, rc 0) 00000100:00100000:3.0:1787784669.268851:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+7:13791:x1874627634767744:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 185us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.268858:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:1.0:1787784669.272659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.272756:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634767872 00000100:00100000:0.0:1787784669.272765:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634767872 00000100:00100000:0.0:1787784669.272812:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:0.0:1787784669.272819:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+7:13791:x1874627634767872:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784669.273453:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13791:x1874627634767872:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 630us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.273463:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:0.0:1787784669.276306:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.276402:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768000 00000100:00100000:3.0:1787784669.276412:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768000 00000100:00100000:3.0:1787784669.276467:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:3.0:1787784669.276477:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13791:x1874627634768000:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787784669.276793:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13791:x1874627634768000:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 317us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.276802:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:1.0:1787784669.287429:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784669.287782:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768128 00000100:00100000:2.0:1787784669.287807:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768128 00000100:00100000:2.0:1787784669.287872:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:2.0:1787784669.287883:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13810:x1874627634768128:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787784669.288240:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13810:x1874627634768128:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 356us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784669.288249:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:1.0:1787784669.313934:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.314101:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768256 00000100:00100000:0.0:1787784669.314111:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768256 00000100:00100000:0.0:1787784669.314316:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:0.0:1787784669.314328:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13810:x1874627634768256:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784669.314621:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13810:x1874627634768256:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 296us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.314629:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:2.0:1787784669.333543:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.333939:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768384 00000100:00100000:0.0:1787784669.333958:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768384 00000100:00100000:0.0:1787784669.334022:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:0.0:1787784669.334033:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+8:13791:x1874627634768384:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784669.334058:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784669.334077:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee89a00/0xffb8d925c20bbd54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ad64 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.334105:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee89a00/0xffb8d925c20bbd54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad64 expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.334138:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee89a00/0xffb8d925c20bbd54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad64 expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.334147:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89a00, rc 0) 00000100:00100000:0.0:1787784669.334209:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:13791:x1874627634768384:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 180us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.334216:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:1.0:1787784669.342530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.342636:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768512 00000100:00100000:0.0:1787784669.342646:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768512 00000100:00100000:0.0:1787784669.342706:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:0.0:1787784669.342717:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:13791:x1874627634768512:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787784669.342751:0:14410:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787784669.342774:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787784669.342778:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787784669.342781:0:14410:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787784669.342783:0:14410:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787784669.346083:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:13791:x1874627634768512:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 3356us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.346098:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:3.0:1787784669.357775:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.360780:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768640 00000100:00100000:0.0:1787784669.360797:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768640 00000100:00100000:0.0:1787784669.360877:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:0.0:1787784669.360888:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+9:13791:x1874627634768640:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784669.360906:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784669.360930:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ad6b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.360984:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.361007:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.361017:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88400, rc 0) 00000100:00100000:0.0:1787784669.361105:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13791:x1874627634768640:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 219us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.361113:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1787784669.365702:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.365837:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768768 00000100:00100000:0.0:1787784669.365847:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768768 00000100:00100000:0.0:1787784669.365913:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1787784669.365923:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13791:x1874627634768768:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784669.366565:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13791:x1874627634768768:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 641us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.366575:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:1.0:1787784669.368959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784669.369170:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634768896 00000100:00100000:2.0:1787784669.369180:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634768896 00000100:00100000:2.0:1787784669.369248:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:2.0:1787784669.369258:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13791:x1874627634768896:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787784669.369579:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13791:x1874627634768896:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 321us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784669.369588:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:2.0:1787784669.380571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.380791:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769024 00000100:00100000:0.0:1787784669.380801:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769024 00000100:00100000:0.0:1787784669.380924:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:0.0:1787784669.380934:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13812:x1874627634769024:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784669.381998:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13812:x1874627634769024:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 1049us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.382008:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:1.0:1787784669.390904:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.391116:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769152 00000100:00100000:3.0:1787784669.391127:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769152 00000100:00100000:3.0:1787784669.391185:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:3.0:1787784669.391197:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13812:x1874627634769152:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784669.391503:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13812:x1874627634769152:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 308us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.391513:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:1.0:1787784669.400588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784669.400809:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769280 00000100:00100000:2.0:1787784669.400820:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769280 00000100:00100000:2.0:1787784669.400970:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784669.400980:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874627634769280:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787784669.401018:0:14415:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c50cf92d-6067-4c10-bfbc-11c55aeaf749@192.168.202.59@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787784669.401073:0:14415:0:(genops.c:1385:class_connect()) connect: client c50cf92d-6067-4c10-bfbc-11c55aeaf749, cookie 0xffb8d925c20bbd62 00000004:00100000:2.0:1787784669.401103:0:14415:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1787784669.401109:0:14415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787784669.497630:0:14415:0:(import.c:65:import_set_state_nolock()) ffff9431884d9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787784669.497722:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2361:x1874627634769280:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 96741us (97142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.497742:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1787784669.507744:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.507841:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.508136:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769536 00000100:00100000:3.0:1787784669.508152:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769536 00000100:00080000:1.0:1787784669.508340:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784669.508593:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769408 00000100:00100000:2.0:1787784669.508599:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769408 00000100:00100000:2.0:1787784669.508685:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784669.508705:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:13791:x1874627634769536:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787784669.508759:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787784669.508850:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:13791:x1874627634769536:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 148us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784669.508936:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784669.508969:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1787784669.508978:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:0:x1874627634769408:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787784669.508991:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787784669.509016:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:0:x1874627634769408:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 40us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784669.509022:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1787784669.518063:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.518507:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769664 00000100:00100000:0.0:1787784669.518517:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769664 00000100:00100000:0.0:1787784669.518580:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784669.518590:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13791:x1874627634769664:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787784669.518678:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13791:x1874627634769664:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 89us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.518685:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1787784669.522155:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784669.525501:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784669.534128:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784669.535104:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770048 00000100:00100000:1.0:1787784669.535117:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770048 00000100:00100000:1.0:1787784669.535165:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784669.535174:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13791:x1874627634770048:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787784669.535769:0:14418:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 527us 00000100:00100000:2.0:1787784669.539049:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769792 00000100:00100000:2.0:1787784669.539189:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769792 00000100:00100000:0.0:1787784669.539465:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634769920 00000100:00100000:0.0:1787784669.539470:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634769920 00000100:00100000:0.0:1787784669.539533:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784669.539541:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634769920:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784669.539573:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c50cf92d-6067-4c10-bfbc-11c55aeaf749@192.168.202.59@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787784669.539601:0:15102:0:(genops.c:1385:class_connect()) connect: client c50cf92d-6067-4c10-bfbc-11c55aeaf749, cookie 0xffb8d925c20bbd69 00002000:00100000:0.0:1787784669.539614:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c50cf92d-6067-4c10-bfbc-11c55aeaf749/ffff9431bea52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784669.539625:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784669.541025:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784669.541069:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431bea57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784669.541147:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2361:x1874627634769920:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1604us (15654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.541156:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1787784669.541179:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784669.541185:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634769792:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784669.541206:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c50cf92d-6067-4c10-bfbc-11c55aeaf749@192.168.202.59@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787784669.541227:0:15102:0:(genops.c:1385:class_connect()) connect: client c50cf92d-6067-4c10-bfbc-11c55aeaf749, cookie 0xffb8d925c20bbd70 00002000:00100000:0.0:1787784669.541249:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c50cf92d-6067-4c10-bfbc-11c55aeaf749/ffff9431bea51000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784669.541268:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784669.542670:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784669.542708:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431bea51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784669.542812:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2361:x1874627634769792:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1624us (20666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.542822:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000004:00200000:3.0:1787784669.558002:0:14418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787784669.559023:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13791:x1874627634770048:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 23840us (24897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784669.559039:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000040:00080000:0.0:1787784669.621083:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787784669.911768:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784669.911975:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770176 00000100:00100000:0.0:1787784669.911986:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770176 00000100:00100000:0.0:1787784669.912048:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1787784669.912060:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13834:x1874627634770176:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:0.0:1787784669.912093:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784669.912120:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bbd77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ad95 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912189:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912203:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912219:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784669.912481:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787784669.912485:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784669.912580:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912630:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88600/0xffb8d925c20bbd77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad95 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912648:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad95 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784669.912656:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:0.0:1787784669.912659:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784669.912663:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88c00, rc 0) 00000100:00100000:0.0:1787784669.912741:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:13834:x1874627634770176:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 683us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784669.912749:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00010000:00010000:2.0:1787784670.132622:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784671.157025:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784671.935881:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784671.935970:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770304 00000100:00100000:3.0:1787784671.935981:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770304 00000100:00100000:3.0:1787784671.936063:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1787784671.936074:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:13886:x1874627634770304:12345-192.168.202.59@tcp:41:lfs.0 00000004:00000024:3.0:1787784671.936120:0:14416:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787784671.936393:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787784671.936465:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:13886:x1874627634770304:12345-192.168.202.59@tcp:41:lfs.0 Request processed in 391us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784671.936474:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784671.955833:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784671.955925:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770432 00000100:00100000:0.0:1787784671.955935:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770432 00000100:00100000:0.0:1787784671.956004:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:0.0:1787784671.956015:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13886:x1874627634770432:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:0.0:1787784671.956055:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784671.956138:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13886:x1874627634770432:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784671.956146:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00080000:1.0:1787784671.956207:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784671.963105:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784671.969704:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770560 00000100:00100000:0.0:1787784671.969731:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770560 00000100:00100000:0.0:1787784671.969827:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784671.969840:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13886:x1874627634770560:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:0.0:1787784671.969884:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784671.970010:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:13886:x1874627634770560:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 173us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784671.970019:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00080000:1.0:1787784671.970758:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787784672.180674:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784672.198581:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.198744:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770688 00000100:00100000:0.0:1787784672.198759:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770688 00000100:00100000:0.0:1787784672.198850:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:0.0:1787784672.198863:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+10:13921:x1874627634770688:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784672.198887:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784672.198913:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbd85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ad9c expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.198951:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad9c expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.198963:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee88600/0xffb8d925c20bbd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad9c expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.198973:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88600, rc 0) 00000100:00100000:0.0:1787784672.199060:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634770688:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 200us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.199068:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:2.0:1787784672.204336:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.204672:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770816 00000100:00100000:0.0:1787784672.204686:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770816 00000100:00100000:0.0:1787784672.204778:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1787784672.204791:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634770816:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787784672.205224:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634770816:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 434us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.205245:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:2.0:1787784672.208092:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.208464:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634770944 00000100:00100000:3.0:1787784672.208488:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634770944 00000100:00100000:3.0:1787784672.208688:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:3.0:1787784672.208702:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634770944:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787784672.218052:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634770944:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 9330us (9961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.218085:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:2.0:1787784672.225568:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.226125:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771072 00000100:00100000:3.0:1787784672.226139:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771072 00000100:00100000:3.0:1787784672.226213:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:3.0:1787784672.226224:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943187085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13926:x1874627634771072:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784672.226648:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943187085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13926:x1874627634771072:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 424us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.226664:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:2.0:1787784672.240438:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.248809:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771200 00000100:00100000:0.0:1787784672.248904:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771200 00000100:00100000:0.0:1787784672.249012:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:0.0:1787784672.249026:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13926:x1874627634771200:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787784672.250464:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13926:x1874627634771200:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 1423us (10024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.250480:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:2.0:1787784672.259574:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.259812:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771328 00000100:00100000:0.0:1787784672.259826:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771328 00000100:00100000:0.0:1787784672.259968:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:0.0:1787784672.259980:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13921:x1874627634771328:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787784672.260006:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784672.260033:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bbd8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849adc6 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.260076:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bbd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adc6 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.260091:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bee89e00/0xffb8d925c20bbd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adc6 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784672.260102:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89e00, rc 0) 00000100:00100000:0.0:1787784672.260248:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13921:x1874627634771328:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 267us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.260257:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:2.0:1787784672.273038:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784672.273191:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771456 00000100:00100000:1.0:1787784672.273206:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771456 00000100:00100000:1.0:1787784672.273457:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:1.0:1787784672.273472:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13921:x1874627634771456:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787784672.273508:0:14408:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787784672.273531:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787784672.273536:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787784672.273540:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787784672.273542:0:14408:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787784672.276343:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13921:x1874627634771456:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 2854us (3361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.276389:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:2.0:1787784672.284228:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.284651:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771584 00000100:00100000:3.0:1787784672.284666:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771584 00000100:00100000:3.0:1787784672.284788:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:3.0:1787784672.284802:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13921:x1874627634771584:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787784672.284827:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784672.284864:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849adcd expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784672.284904:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784672.284917:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 13 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784672.284927:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269e400, rc 0) 00000100:00100000:3.0:1787784672.285129:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13921:x1874627634771584:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 329us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.285137:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:2.0:1787784672.288356:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784672.288565:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771712 00000100:00100000:1.0:1787784672.288579:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771712 00000100:00100000:1.0:1787784672.288744:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:1.0:1787784672.288756:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13921:x1874627634771712:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787784672.289306:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13921:x1874627634771712:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 549us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.289316:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1787784672.295519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.295635:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771840 00000100:00100000:3.0:1787784672.295650:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771840 00000100:00100000:3.0:1787784672.295784:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:3.0:1787784672.295798:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13921:x1874627634771840:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787784672.296462:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13921:x1874627634771840:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 663us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.296473:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:2.0:1787784672.300728:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784672.301028:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634771968 00000100:00100000:1.0:1787784672.301042:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634771968 00000100:00100000:1.0:1787784672.301172:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:1.0:1787784672.301185:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13930:x1874627634771968:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787784672.301647:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13930:x1874627634771968:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 463us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.301657:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:2.0:1787784672.314892:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.315062:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772096 00000100:00100000:3.0:1787784672.315076:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772096 00000100:00100000:3.0:1787784672.315152:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:3.0:1787784672.315163:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13930:x1874627634772096:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787784672.315546:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13930:x1874627634772096:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 384us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.315553:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:2.0:1787784672.326540:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.326568:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.326591:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.326631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.326681:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772864 00000100:00100000:2.0:1787784672.326696:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772864 00000100:00100000:2.0:1787784672.326772:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772736 00000100:00100000:2.0:1787784672.326777:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772736 00000100:00100000:2.0:1787784672.326797:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784672.326808:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2363:x1874627634772864:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784672.327055:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2363:x1874627634772864:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 247us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784672.327065:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784672.327086:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1787784672.327093:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2363:x1874627634772736:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784672.327337:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2363:x1874627634772736:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 243us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784672.327345:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:0.0:1787784672.327627:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772224 00000100:00100000:0.0:1787784672.327632:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772224 00000100:00100000:0.0:1787784672.327674:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772608 00000100:00100000:0.0:1787784672.327679:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772608 00000100:00100000:0.0:1787784672.327714:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784672.327723:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2363:x1874627634772608:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1787784672.327762:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2363:x1874627634772608:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 41us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.327769:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784672.327784:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1787784672.327789:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba2592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874627634772224:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787784672.327823:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e94ca4a8-f17e-4bfb-939c-0ba59f45e136@192.168.202.59@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787784672.327890:0:14417:0:(genops.c:1385:class_connect()) connect: client e94ca4a8-f17e-4bfb-939c-0ba59f45e136, cookie 0xffb8d925c20bbd9a 00000004:00100000:0.0:1787784672.327937:0:14417:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1787784672.328121:0:14417:0:(import.c:65:import_set_state_nolock()) ffff9431bea56000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784672.328161:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba2592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2361:x1874627634772224:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 369us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.328169:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1787784672.342566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.342683:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.342757:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772480 00000100:00100000:0.0:1787784672.342770:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772480 00000100:00100000:0.0:1787784672.342863:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772352 00000100:00100000:0.0:1787784672.342867:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772352 00000100:00100000:0.0:1787784672.342888:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784672.342901:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+7:13921:x1874627634772480:12345-192.168.202.59@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787784672.342922:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787784672.342956:0:14416:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000004:00000024:0.0:1787784672.342969:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787784672.342979:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787784672.343068:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+7:13921:x1874627634772480:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 170us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.343091:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784672.343115:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784672.343123:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:0:x1874627634772352:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787784672.343136:0:14417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787784672.343161:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:0:x1874627634772352:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 40us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.343168:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784672.344914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784672.345014:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634772992 00000100:00100000:3.0:1787784672.345024:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634772992 00000100:00100000:3.0:1787784672.345069:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1787784672.345079:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:13921:x1874627634772992:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787784672.345198:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:13921:x1874627634772992:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 120us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.345206:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1787784672.347499:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784672.347596:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784672.347634:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773120 00000100:00100000:2.0:1787784672.347647:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773120 00000100:00100000:2.0:1787784672.347692:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773248 00000100:00100000:2.0:1787784672.347696:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773248 00000100:00100000:0.0:1787784672.347722:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784672.347732:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634773120:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784672.347773:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e94ca4a8-f17e-4bfb-939c-0ba59f45e136@192.168.202.59@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787784672.347822:0:15102:0:(genops.c:1385:class_connect()) connect: client e94ca4a8-f17e-4bfb-939c-0ba59f45e136, cookie 0xffb8d925c20bbda1 00002000:00100000:0.0:1787784672.347839:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e94ca4a8-f17e-4bfb-939c-0ba59f45e136/ffff9431b3c68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784672.347854:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784672.348018:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787784672.348058:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431b3c6a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784672.348142:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2361:x1874627634773120:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 409us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.348152:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784672.348172:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1787784672.348176:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874627634773248:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787784672.348204:0:15102:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e94ca4a8-f17e-4bfb-939c-0ba59f45e136@192.168.202.59@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787784672.348223:0:15102:0:(genops.c:1385:class_connect()) connect: client e94ca4a8-f17e-4bfb-939c-0ba59f45e136, cookie 0xffb8d925c20bbda8 00002000:00100000:0.0:1787784672.348247:0:15102:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e94ca4a8-f17e-4bfb-939c-0ba59f45e136/ffff9431962b8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113936 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787784672.348253:0:15102:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1787784672.348319:0:15102:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787784672.348335:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9431962b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787784672.348407:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2361:x1874627634773248:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 229us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784672.348415:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784672.349825:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784672.350159:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773376 00000100:00100000:1.0:1787784672.350170:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773376 00000100:00100000:1.0:1787784672.350268:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1787784672.350277:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:13921:x1874627634773376:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787784672.351025:0:14419:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787784672.351225:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:13921:x1874627634773376:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 945us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.351234:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1787784672.555975:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784672.556103:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773504 00000100:00100000:1.0:1787784672.556117:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773504 00000100:00100000:1.0:1787784672.556193:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1787784672.556225:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:13951:x1874627634773504:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:1.0:1787784672.556255:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784672.556293:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bbdaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849adf7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556430:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556445:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556456:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784672.556733:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787784672.556737:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784672.556820:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556856:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0600/0xffb8d925c20bbdaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556879:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784672.556889:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:1.0:1787784672.556893:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784672.556898:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d0400, rc 0) 00000100:00100000:1.0:1787784672.556981:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+7:13951:x1874627634773504:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 759us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784672.556999:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784672.565425:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643157120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787784672.565536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784672.565717:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157120 00000100:00100000:3.0:1787784672.565730:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157120 00000100:00100000:3.0:1787784672.565856:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787784672.565870:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643157120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787784672.565902:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787784672.566015:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784672.569952:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643157120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3735us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784672.570043:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787784672.570386:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643157120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787784673.204744:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787784673.718064:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000001:00100000:2.0:1787784673.718081:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000100:00100000:0.0:1787784674.102455:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643157248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784674.102566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784674.102672:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157248 00000100:00100000:0.0:1787784674.102683:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157248 00000100:00100000:0.0:1787784674.102774:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787784674.102786:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643157248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787784674.102841:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784674.102899:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643157248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784674.102907:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787784674.102931:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787784674.102979:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643157248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787784674.105103:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643157504:0@lo:400:kworker.0 00000100:00100000:3.0:1787784674.105190:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784674.105645:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787784674.105656:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643157376:0@lo:400:kworker.0 00000100:00100000:3.0:1787784674.105715:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784674.105750:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643157888:0@lo:400:kworker.0 00000100:00100000:3.0:1787784674.105781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784674.106155:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157504 00000100:00100000:1.0:1787784674.106166:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157504 00000100:00100000:0.0:1787784674.106334:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157888 00000100:00100000:0.0:1787784674.106339:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157888 00000100:00100000:0.0:1787784674.106404:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784674.106417:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.106496:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1874627643157888:12345-0@lo:400:kworker.0 Request processed in 82us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784674.106503:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787784674.106548:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643157632:0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.106578:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784674.106877:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784674.106888:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643157504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784674.106934:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643157504:12345-0@lo:400:kworker.0 Request processed in 49us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784674.106940:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787784674.106964:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157376 00000100:00100000:1.0:1787784674.106968:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157376 00000100:00100000:0.0:1787784674.107537:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157632 00000100:00100000:0.0:1787784674.107544:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157632 00000100:00100000:0.0:1787784674.107765:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784674.107777:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643157632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.107839:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1874627643157632:12345-0@lo:400:kworker.0 Request processed in 66us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784674.107846:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787784674.107889:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3295:1874627643157632:0@lo:400:kworker.0 00000100:00080000:0.0:1787784674.107916:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787784674.107923:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784674.107955:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3294:1874627643157888:0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.107970:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643157504:0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.108008:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643157760:0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.108045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784674.108070:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643157760 00000100:00100000:0.0:1787784674.108073:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643157760 00000100:00100000:0.0:1787784674.108105:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787784674.108111:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643157760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784674.108146:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4199e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643157760:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784674.108152:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787784674.108168:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784674.108185:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643157760:0@lo:400:kworker.0 00000100:00100000:1.0:1787784674.109578:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787784674.109611:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3294:x1874627643157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784674.109717:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3294:x1874627643157376:12345-0@lo:400:kworker.0 Request processed in 128us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784674.109726:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787784674.109958:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643157376:0@lo:400:kworker.0 00010000:00010000:2.0:1787784674.234167:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787784674.708804:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000001:00100000:3.0:1787784674.708828:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00000001:00100000:3.0:1787784674.713864:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e94ca4a8-f17e-4bfb-939c-0ba59f45e136 00000001:00100000:3.0:1787784674.713886:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c50cf92d-6067-4c10-bfbc-11c55aeaf749 00010000:00010000:1.0:1787784675.254009:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787784675.773275:0:16384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787784676.276846:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787784677.301064:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787784677.625733:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625788:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625818:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625841:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625888:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784677.625939:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773632 00000100:00100000:2.0:1787784677.625952:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773632 00000100:00100000:2.0:1787784677.626020:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00100000:2.0:1787784677.626032:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2364:x1874627634773632:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626126:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2364:x1874627634773632:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626134:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00100000:2.0:1787784677.626194:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773888 00000100:00100000:2.0:1787784677.626199:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773888 00000100:00100000:2.0:1787784677.626234:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774400 00000100:00100000:2.0:1787784677.626238:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774400 00000100:00100000:2.0:1787784677.626255:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774016 00000100:00100000:2.0:1787784677.626258:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774016 00000100:00100000:2.0:1787784677.626270:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774272 00000100:00100000:2.0:1787784677.626272:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774272 00000100:00100000:2.0:1787784677.626286:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784677.626293:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634773888:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626323:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634773888:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626331:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784677.626343:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1787784677.626349:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634774400:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626403:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634774400:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 53us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626409:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1787784677.626425:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1787784677.626432:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634774016:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626456:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634774016:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626462:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1787784677.626472:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784677.626478:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634774272:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626501:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634774272:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626514:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784677.626534:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774144 00000100:00100000:2.0:1787784677.626538:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774144 00000100:00100000:2.0:1787784677.626569:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634773760 00000100:00100000:2.0:1787784677.626571:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634773760 00000100:00100000:2.0:1787784677.626591:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1787784677.626598:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2364:x1874627634774144:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626629:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2364:x1874627634774144:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626636:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1787784677.626647:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784677.626654:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2364:x1874627634773760:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784677.626690:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2364:x1874627634773760:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 37us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784677.626697:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00080000:2.0:1787784677.626875:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784677.626881:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784677.626883:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787784677.687717:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784677.687749:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787784677.687836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784677.687928:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158016 00000100:00100000:1.0:1787784677.687939:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158016 00000100:00100000:1.0:1787784677.688022:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787784677.688032:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784677.688095:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784677.688277:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784677.688286:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787784677.688422:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784677.688464:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787784678.328149:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784679.224317:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643158272:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.224411:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.224461:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643158784:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.224488:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.224511:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787784679.224516:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643158144:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.224544:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.224574:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643158656:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.224601:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.226218:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158400:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226277:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.226310:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784679.226318:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643158528:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226346:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.226435:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784679.226476:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.226520:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158272 00000100:00100000:2.0:1787784679.226527:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158272 00000100:00100000:2.0:1787784679.226581:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158400 00000100:00100000:2.0:1787784679.226585:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158400 00000100:00100000:2.0:1787784679.226604:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784679.226613:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643158272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226682:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874627643158272:12345-0@lo:400:kworker.0 Request processed in 70us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.226689:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784679.226709:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784679.226715:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226748:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158400:12345-0@lo:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.226755:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787784679.226773:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158784 00000100:00100000:2.0:1787784679.226776:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158784 00000100:00100000:2.0:1787784679.226800:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158656 00000100:00100000:2.0:1787784679.226803:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158656 00000100:00100000:2.0:1787784679.226816:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158528 00000100:00100000:2.0:1787784679.226818:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158528 00000100:00100000:2.0:1787784679.226830:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784679.226837:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643158784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226870:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874627643158784:12345-0@lo:400:kworker.0 Request processed in 34us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.226876:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787784679.226888:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784679.226894:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643158656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226931:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874627643158656:12345-0@lo:400:kworker.0 Request processed in 38us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.226938:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787784679.226949:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787784679.226955:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643158528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.226980:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643158528:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.226986:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787784679.227142:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787784679.227146:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787784679.227148:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784679.227179:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643158528:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.227192:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158400:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.227240:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3296:1874627643158656:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.227251:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3296:1874627643158272:0@lo:400:kworker.0 00000100:00100000:2.0:1787784679.227261:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3296:1874627643158784:0@lo:400:kworker.0 00000100:00100000:3.0:1787784679.227389:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158912 00000100:00100000:3.0:1787784679.227395:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158912 00000100:00100000:0.0:1787784679.227420:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643158144 00000100:00100000:0.0:1787784679.227427:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643158144 00000100:00100000:3.0:1787784679.227439:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787784679.227451:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158912:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784679.227464:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787784679.227475:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643158144:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787784679.227482:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787784679.227523:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:3296:x1874627643158144:12345-0@lo:400:kworker.0 Request processed in 51us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.227530:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787784679.227541:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643158912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.227561:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787784679.229773:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643158912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787784679.229821:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:459db144-24ce-4979-944c-65e392f5ff2a:3296:1874627643158144:0@lo:400:kworker.0 00010000:00010000:1.0:1787784679.348472:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787784679.728509:0:16532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffa722530 20000000:00000080:3.0:1787784679.728536:0:16532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94308359dc00 uarg=0000000000000000 20000000:01000000:3.0:1787784679.728769:0:16532:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787784679.728776:0:16532:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787784679.728782:0:16532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787784679.731040:0:16533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787784679.742835:0:16532:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787784679.753245:0:16532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787784679.754061:0:16532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754089:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754099:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754107:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754119:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754128:0:16532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754138:0:16532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754197:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754241:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 12 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.754262:0:16532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159040:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784679.754441:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 12 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754450:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 12 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.754458:0:16532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159168:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784679.754492:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754501:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 18 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.754511:0:16532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159296:0@lo:104: 00000100:00100000:3.0:1787784679.754683:0:16532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784679.754739:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754748:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 18 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.754756:0:16532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159424:0@lo:104: 00000100:00100000:3.0:1787784679.754779:0:16532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787784679.754821:0:16532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.754830:0:16532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 18 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.754838:0:16532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159552:0@lo:104: 00000100:00100000:3.0:1787784679.754865:0:16532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784679.754876:0:16532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784679.754959:0:14399:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787784679.754977:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159296 00000100:00100000:0.0:1787784679.754986:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159296 00000100:00100000:0.0:1787784679.755036:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159424 00000100:00100000:0.0:1787784679.755040:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159424 00000100:00100000:0.0:1787784679.755052:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159552 00000100:00100000:0.0:1787784679.755054:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159552 00000100:00100000:0.0:1787784679.755068:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784679.755078:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+5:16532:x1874627643159296:12345-0@lo:104: 00010000:00010000:0.0:1787784679.755095:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755168:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787784679.755175:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+5:16532:x1874627643159296:12345-0@lo:104: Request processed in 98us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.755183:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787784679.755204:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784679.755211:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+4:16532:x1874627643159424:12345-0@lo:104: 00010000:00010000:0.0:1787784679.755218:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755261:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787784679.755266:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+4:16532:x1874627643159424:12345-0@lo:104: Request processed in 57us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.755273:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787784679.755284:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787784679.755290:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bb366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:16532:x1874627643159552:12345-0@lo:104: 00010000:00010000:0.0:1787784679.755298:0:14399:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755323:0:14399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787784679.755329:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bb366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:459db144-24ce-4979-944c-65e392f5ff2a+3:16532:x1874627643159552:12345-0@lo:104: Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.755334:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787784679.755406:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787784679.755413:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755422:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943185610000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784679.755427:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755437:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784679.755445:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784679.755451:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784679.755493:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755501:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784679.755523:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755530:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff943185610000/0xffb8d925c20bbc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbc35 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755543:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787784679.755547:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755553:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500800 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784679.755556:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755575:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784679.755582:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784679.755588:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784679.755601:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755608:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784679.755620:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755647:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bf500800/0xffb8d925c20bbafa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbb01 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755657:0:14404:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784679.755660:0:14404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755666:0:14404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc1c19c20) 10000000:00010000:0.0:1787784679.755670:0:14404:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755677:0:14404:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787784679.755684:0:14404:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787784679.755689:0:14404:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787784679.755703:0:14404:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755711:0:14404:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787784679.755717:0:14404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755723:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff9431bee89000/0xffb8d925c20bbaad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xffb8d925c20bbab4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.755740:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784679.755747:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784679.755749:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784679.755756:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784679.755902:0:16532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159296:0@lo:104: 00000100:00100000:3.0:1787784679.755911:0:16532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159424:0@lo:104: 00000100:00100000:3.0:1787784679.755917:0:16532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159552:0@lo:104: 00000100:00100000:2.0:1787784679.756205:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b4198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643159680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784679.756244:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.756295:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643159808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784679.756317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.756334:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784679.756339:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643159936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784679.756359:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784679.756421:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159680 00000100:00100000:2.0:1787784679.756426:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159680 00010000:00010000:2.0:1787784679.756451:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 19 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.756468:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159808 00000100:00100000:2.0:1787784679.756471:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159808 00010000:00010000:2.0:1787784679.756480:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 20 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.756489:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643159936 00000100:00100000:2.0:1787784679.756491:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643159936 00010000:00010000:2.0:1787784679.756499:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 21 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.756510:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784679.756517:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459db144-24ce-4979-944c-65e392f5ff2a+21:3294:x1874627643159680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787784679.756530:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784679.756535:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.756546:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784679.757254:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bf501200/0xffb8d925c20bbc35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bbc2e expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784679.757510:0:14401:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787784679.757522:0:14401:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787784679.757549:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787784679.757568:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784679.757579:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+21:3295:x1874627643159808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784679.757593:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784679.757599:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757610:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757624:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88800/0xffb8d925c20bbb01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bbafa expref: 21 pid: 14410 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757652:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784679.757712:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+20:3295:x1874627643159808:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.757726:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787784679.757747:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787784679.757752:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787784679.757757:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b299f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643159936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787784679.757764:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784679.757769:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 19 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757778:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 19 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757788:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431829d1c00/0xffb8d925c20bbab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xffb8d925c20bbaad expref: 19 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.757797:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784679.757816:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b299f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:459db144-24ce-4979-944c-65e392f5ff2a+18:3295:x1874627643159936:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.757822:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787784679.758108:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784679.758144:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:459db144-24ce-4979-944c-65e392f5ff2a+16:3294:x1874627643159680:12345-0@lo:103:ldlm_bl.0 Request processed in 1627us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784679.758150:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787784679.758220:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643159936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787784679.758229:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643159808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784679.761022:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b4198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:459db144-24ce-4979-944c-65e392f5ff2a:3294:1874627643159680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787784679.765176:0:16532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159040:192.168.202.59@tcp:104: 00000100:00100000:3.0:1787784679.765258:0:16532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16532:1874627643159168:192.168.202.59@tcp:104: 00010000:00010000:3.0:1787784679.765305:0:16532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784679.765353:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784679.766852:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784679.767053:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774528 00000100:00100000:0.0:1787784679.767066:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774528 00010000:00010000:0.0:1787784679.767131:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 13 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784679.767191:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774656 00000100:00100000:0.0:1787784679.767195:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774656 00010000:00010000:0.0:1787784679.767210:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 14 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784679.767239:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1787784679.767251:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:694b64e1-3991-40c4-9fdb-8a8fe572759c+14:2362:x1874627634774528:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784679.767273:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784679.767279:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 14 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.767294:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 14 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.767320:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269e400/0xffb8d925c20bbd93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adcd expref: 14 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784679.767342:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787784679.768147:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1787784679.768164:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2362:x1874627634774656:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787784679.768201:0:14403:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784679.768209:0:14403:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 13 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768222:0:14403:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 13 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768240:0:14403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9431bee88400/0xffb8d925c20bbd5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ad6b expref: 13 pid: 14411 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768258:0:14403:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768269:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768290:0:14403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768298:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768305:0:14403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768313:0:14403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768320:0:14403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269e600 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784679.768325:0:14403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768345:0:14403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768380:0:14403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768397:0:14403:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784679.768759:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:2362:x1874627634774528:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1506us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784679.768770:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784679.768831:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:2362:x1874627634774656:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 672us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784679.768839:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00010000:00010000:3.0:1787784679.768868:0:16532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768877:0:16532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784679.768884:0:16532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdbd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787784679.940174:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787784680.372985:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787784681.268703:0:14413:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787784681.268714:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b3c6d800 from 10 10000000:01000000:0.0:1787784681.268722:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787784681.268784:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.268798:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.268811:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784681.268845:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787784681.268937:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784681.269049:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.269249:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160064 00000100:00100000:3.0:1787784681.269260:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160064 00000100:00100000:3.0:1787784681.269327:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787784681.269340:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+16:14413:x1874627643160064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784681.269357:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784681.269405:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269e000/0xffb8d925c20bbdcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbdc4 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.269436:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269e000/0xffb8d925c20bbdcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbdc4 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.269470:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269e000/0xffb8d925c20bbdcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbdc4 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.269481:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269e000, rc 0) 00000100:00100000:3.0:1787784681.269554:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.269561:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787784681.269819:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b419a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784681.269841:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.269852:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.269943:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.269976:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784681.269993:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318574b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787784681.270395:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160192 00000100:00100000:0.0:1787784681.270402:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160192 00000100:00100000:0.0:1787784681.270434:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787784681.270441:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784681.274238:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3782us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784681.274257:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787784681.274502:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.274598:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.274694:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784681.275414:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160320 00000100:00100000:3.0:1787784681.275424:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160320 00000100:00100000:3.0:1787784681.275468:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787784681.275478:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784681.275960:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 481us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.275968:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787784681.291901:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318574b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784681.291969:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784681.296073:0:16585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787784681.296466:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787784681.296500:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787784681.296514:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.296573:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bee88800/0xffb8d925c20bbdc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdcb expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787784681.296587:0:14413:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787784681.296590:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff943186233000 from 10 10000000:01000000:1.0:1787784681.296594:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787784681.296657:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.296667:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.296679:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.296712:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.296806:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784681.296867:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318574b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.297140:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160448 00000100:00100000:3.0:1787784681.297150:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160448 00000100:00100000:3.0:1787784681.297222:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787784681.297234:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+17:14413:x1874627643160448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784681.297253:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784681.297270:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbdd2 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.297302:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbdd2 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.297314:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269e600/0xffb8d925c20bbdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbdd2 expref: 18 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.297339:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269e600, rc 0) 00000100:00100000:3.0:1787784681.297446:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.297454:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787784681.297857:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787784681.297878:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784681.297900:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784681.297977:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.298015:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784681.298071:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318574b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784681.305029:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160576 00000100:00100000:2.0:1787784681.305052:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160576 00000100:00100000:2.0:1787784681.305126:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787784681.305139:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.305596:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 458us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.305631:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787784681.307062:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.307150:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787784681.307246:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784681.307294:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318574b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784681.307780:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160704 00000100:00100000:2.0:1787784681.307789:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160704 00000100:00100000:2.0:1787784681.307857:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787784681.307867:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.308140:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.308149:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787784681.308443:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787784681.318360:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787784681.318847:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787784681.318877:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787784681.318903:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.318917:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431829d0600/0xffb8d925c20bbdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbdd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787784681.318929:0:14413:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787784681.318932:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9431b9fc6000 from 10 10000000:01000000:2.0:1787784681.318935:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787784681.318989:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.318999:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.319011:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784681.319043:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.319137:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784681.319206:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186264240 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.319423:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160832 00000100:00100000:3.0:1787784681.319433:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160832 00000100:00100000:3.0:1787784681.319491:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787784681.319504:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+18:14413:x1874627643160832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787784681.319521:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784681.319537:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94308269f000/0xffb8d925c20bbde7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xffb8d925c20bbde0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.319567:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94308269f000/0xffb8d925c20bbde7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xffb8d925c20bbde0 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.319579:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94308269f000/0xffb8d925c20bbde7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xffb8d925c20bbde0 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.319589:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269f000, rc 0) 00000100:00100000:3.0:1787784681.320294:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643160832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 788us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.320305:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787784681.320504:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf699680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787784681.320529:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.320543:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784681.320671:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b41992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784681.320712:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784681.320752:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bee8df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787784681.320997:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643160960 00000100:00100000:3.0:1787784681.321004:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643160960 00000100:00100000:3.0:1787784681.321050:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787784681.321060:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643160960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787784681.326574:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:459db144-24ce-4979-944c-65e392f5ff2a+19:14413:x1874627643160960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5502us (5848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.326593:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787784681.326805:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b41992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643160960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.326899:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643161088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.326974:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784681.327004:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff943186264c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787784681.327034:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161088 00000100:00100000:2.0:1787784681.327042:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161088 00000100:00100000:2.0:1787784681.327101:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787784681.327111:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+20:14413:x1874627643161088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787784681.327321:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:459db144-24ce-4979-944c-65e392f5ff2a+20:14413:x1874627643161088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.327328:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787784681.327399:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:459db144-24ce-4979-944c-65e392f5ff2a:14413:1874627643161088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787784681.328778:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787784681.329397:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787784681.329426:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787784681.329441:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784681.329456:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff9431bf500200/0xffb8d925c20bbde0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xffb8d925c20bbde7 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784681.404451:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784681.722763:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784681.722866:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774784 00000100:00100000:2.0:1787784681.722879:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774784 00000100:00100000:2.0:1787784681.722963:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:2.0:1787784681.722976:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+11:13806:x1874627634774784:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784681.723000:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.723027:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500800/0xffb8d925c20bbdee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849adfe expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.723071:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500800/0xffb8d925c20bbdee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adfe expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.723085:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500800/0xffb8d925c20bbdee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adfe expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.723097:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500800, rc 0) 00000100:00100000:2.0:1787784681.723185:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634774784:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 211us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.723194:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:3.0:1787784681.732322:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784681.732544:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634774912 00000100:00100000:0.0:1787784681.732558:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634774912 00000100:00100000:0.0:1787784681.732650:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:0.0:1787784681.732663:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634774912:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784681.733108:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634774912:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 446us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784681.733117:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:0.0:1787784681.735514:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784681.736714:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775040 00000100:00100000:3.0:1787784681.736731:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775040 00000100:00100000:3.0:1787784681.736812:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:3.0:1787784681.736826:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634775040:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784681.737131:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634775040:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 307us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.737141:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:1.0:1787784681.761163:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784681.761910:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775168 00000100:00100000:2.0:1787784681.761928:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775168 00000100:00100000:2.0:1787784681.762029:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:2.0:1787784681.762041:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+12:13806:x1874627634775168:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787784681.762066:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784681.762091:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9431bf500e00/0xffb8d925c20bbdf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x845202732849ae05 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.762129:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9431bf500e00/0xffb8d925c20bbdf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae05 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.762143:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9431bf500e00/0xffb8d925c20bbdf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae05 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784681.762155:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf500e00, rc 0) 00000100:00100000:2.0:1787784681.762247:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13806:x1874627634775168:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 208us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784681.762255:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:2.0:1787784681.766501:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784681.766615:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775296 00000100:00100000:0.0:1787784681.766637:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775296 00000100:00100000:0.0:1787784681.766716:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:0.0:1787784681.766728:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13806:x1874627634775296:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787784681.767143:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13806:x1874627634775296:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 414us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784681.767153:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:0.0:1787784681.769711:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784681.770077:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775424 00000100:00100000:3.0:1787784681.770090:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775424 00000100:00100000:3.0:1787784681.770181:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:3.0:1787784681.770193:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13806:x1874627634775424:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787784681.770635:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9feec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:13806:x1874627634775424:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 441us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784681.770655:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00010000:00010000:0.0:1787784682.427392:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784682.746126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746288:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746331:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746357:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746430:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784682.746483:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775808 00000100:00100000:3.0:1787784682.746495:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775808 00000100:00100000:3.0:1787784682.746578:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776320 00000100:00100000:3.0:1787784682.746581:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776320 00000100:00100000:3.0:1787784682.746594:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775936 00000100:00100000:3.0:1787784682.746596:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775936 00000100:00100000:3.0:1787784682.746608:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776192 00000100:00100000:3.0:1787784682.746624:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776192 00000100:00100000:3.0:1787784682.746643:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1787784682.746655:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2365:x1874627634775808:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.746749:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2365:x1874627634775808:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 96us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.746758:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1787784682.746777:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784682.746783:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2365:x1874627634776320:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.746808:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2365:x1874627634776320:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.746815:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784682.746847:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1787784682.746854:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2365:x1874627634775936:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.746878:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2365:x1874627634775936:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.746884:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1787784682.746894:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784682.746901:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2365:x1874627634776192:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.746921:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2365:x1874627634776192:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.746988:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784682.747012:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776064 00000100:00100000:3.0:1787784682.747015:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776064 00000100:00100000:3.0:1787784682.747048:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775680 00000100:00100000:3.0:1787784682.747051:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775680 00000100:00100000:3.0:1787784682.747092:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784682.747099:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2365:x1874627634776064:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.747131:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2365:x1874627634776064:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.747138:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1787784682.747149:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:3.0:1787784682.747156:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2365:x1874627634775680:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784682.747179:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2365:x1874627634775680:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 23us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784682.747185:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00080000:3.0:1787784682.747217:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784682.747223:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787784682.747225:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784682.753069:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634775552 00000100:00100000:2.0:1787784682.753090:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634775552 00000100:00100000:2.0:1787784682.753184:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:2.0:1787784682.753196:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2365:x1874627634775552:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784682.753307:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2365:x1874627634775552:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 112us (7195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784682.753315:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:3.0:1787784682.807952:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787784682.807990:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf670b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643161216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787784682.808115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784682.808409:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161216 00000100:00100000:1.0:1787784682.808422:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161216 00000100:00100000:1.0:1787784682.808544:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787784682.808557:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643161216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784682.808623:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787784682.808695:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643161216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784682.808704:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787784682.808780:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf670b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643161216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787784682.808851:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787784683.444707:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784683.601631:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.601883:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776448 00000100:00100000:2.0:1787784683.601916:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776448 00000100:00100000:2.0:1787784683.601993:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1787784683.602006:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:14461:x1874627634776448:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.602034:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.602066:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbdfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae0c expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602170:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602188:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602203:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602219:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602226:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602233:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602809:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602821:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.602829:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.602923:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787784683.602927:0:14417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784683.603029:0:14417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603041:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603049:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603056:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603063:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.603068:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603076:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603092:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:2.0:1787784683.603095:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.603100:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603107:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603120:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603136:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603142:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603147:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.603150:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603156:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603162:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff943187f1d100) 00010000:00010000:2.0:1787784683.603164:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.603167:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603173:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603215:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbdfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae0c expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603230:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501e00/0xffb8d925c20bbe11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae0c expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.603238:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943187f1d500) 00010000:00010000:2.0:1787784683.603241:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784683.603250:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501e00, rc 0) 00000100:00100000:2.0:1787784683.603351:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:14461:x1874627634776448:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1346us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.603360:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1787784683.612204:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.612431:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776704 00000100:00100000:2.0:1787784683.612445:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776704 00000100:00100000:2.0:1787784683.612527:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1787784683.612540:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:14461:x1874627634776704:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784683.612570:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.612599:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae13 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.612744:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.612764:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.612776:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.612983:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613008:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613020:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613610:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bbe2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613627:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613634:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bbe2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.613646:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787784683.613895:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613902:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613909:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613916:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.613921:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613928:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613940:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff943187f1d500) 00010000:00010000:2.0:1787784683.613944:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.613948:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613955:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbe1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613967:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613979:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613985:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.613990:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.613993:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614000:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614008:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff943187f1d100) 00010000:00010000:2.0:1787784683.614010:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.614014:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614020:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614428:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae13 expref: 10 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614444:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501600/0xffb8d925c20bbe2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae13 expref: 9 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.614454:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943187f1d000) 00010000:00010000:2.0:1787784683.614456:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.614464:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501600, rc 0) 00000100:00100000:2.0:1787784683.614539:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14461:x1874627634776704:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2000us (2353us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787784683.614547:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1787784683.622536:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.622616:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776832 00000100:00100000:2.0:1787784683.622632:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776832 00000100:00100000:2.0:1787784683.622724:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1787784683.622736:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14461:x1874627634776832:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787784683.623024:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14461:x1874627634776832:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 290us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.623033:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1787784683.730581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784683.730676:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634776960 00000100:00100000:1.0:1787784683.730692:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634776960 00000100:00100000:1.0:1787784683.730782:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1787784683.730794:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14467:x1874627634776960:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1787784683.730823:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784683.730852:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bbe3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae1a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.730954:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.730974:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731008:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731027:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731035:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731042:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731348:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.731357:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735207:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735221:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431829d1c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784683.735228:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735240:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735264:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:1.0:1787784683.735268:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784683.735275:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735310:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1c00/0xffb8d925c20bbe42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735340:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735347:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735355:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735361:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512a00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784683.735406:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735414:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735423:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943190486c00) 00010000:00010000:1.0:1787784683.735427:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784683.735430:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735437:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735509:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bbe3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae1a expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735534:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:1.0:1787784683.735537:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787784683.735542:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d1200/0xffb8d925c20bbe3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae1a expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.735553:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431829d1200, rc 0) 00000100:00100000:1.0:1787784683.735663:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14467:x1874627634776960:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 4869us (5092us total) trans 0 rc 301/301 00000100:00100000:1.0:1787784683.735675:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:0.0:1787784683.747631:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.747770:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777088 00000100:00100000:2.0:1787784683.747784:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777088 00000100:00100000:2.0:1787784683.747850:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784683.747871:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b41992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14467:x1874627634777088:12345-192.168.202.59@tcp:700:lfs.0 00000100:00100000:2.0:1787784683.747981:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b41992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14467:x1874627634777088:12345-192.168.202.59@tcp:700:lfs.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.747992:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1787784683.749980:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.750086:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777344 00000100:00100000:2.0:1787784683.750100:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777344 00000100:00100000:2.0:1787784683.750172:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1787784683.750184:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14467:x1874627634777344:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:2.0:1787784683.750260:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784683.750297:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88c00/0xffb8d925c20bbd7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ad95 expref: 9 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.750345:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:2.0:1787784683.750352:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784683.750976:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.750996:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 5 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.751007:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.751054:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 5 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.751072:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 5 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.751091:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643161344:192.168.202.59@tcp:104: 00000100:00100000:2.0:1787784683.751214:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431bf773300 going to sleep for 11 seconds 00000100:00100000:0.0:1787784683.758026:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784683.758126:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777472 00000100:00100000:1.0:1787784683.758139:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777472 00010000:00010000:1.0:1787784683.758197:0:14401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 6 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784683.758292:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784683.758305:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634777472:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784683.758328:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784683.758338:0:14401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 6 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.758355:0:14401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 6 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.758408:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:1.0:1787784683.758415:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.758445:0:14401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.758455:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.758482:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784683.758572:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b4198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2363:x1874627634777472:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 269us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.758581:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00010000:00010000:2.0:1787784683.759131:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431829d0400/0xffb8d925c20bbdb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849adf7 expref: 5 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.759154:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643161344:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784683.759182:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.759192:0:14417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.759209:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.759239:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.759250:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.759260:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.760958:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784683.760980:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.760991:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.760999:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.761006:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.761010:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.761018:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.761035:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943183fdc600) 00010000:00010000:2.0:1787784683.761038:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.761052:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.761060:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbe50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784683.761084:0:14417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001439c694 reply state 000000005e5bbc00 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.761094:0:14417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787784683.761220:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+10:14467:x1874627634777344:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 11032us (11246us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787784683.761230:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00010000:00010000:2.0:1787784683.769016:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769041:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769051:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769058:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784683.769064:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769073:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769096:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943187f1d100) 00010000:00010000:2.0:1787784683.769099:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784683.769106:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.769133:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe57 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784683.845721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784683.846735:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777600 00000100:00100000:1.0:1787784683.846754:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777600 00000100:00100000:1.0:1787784683.846846:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1787784683.846869:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:14475:x1874627634777600:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:1.0:1787784683.846904:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784683.846934:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae21 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847022:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847040:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847053:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787784683.847138:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787784683.847142:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787784683.847235:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847267:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbe5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae21 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847292:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513e00/0xffb8d925c20bbe65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae21 expref: 10 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784683.847303:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:1.0:1787784683.847306:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787784683.847310:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181513e00, rc 0) 00000100:00100000:1.0:1787784683.847478:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+10:14475:x1874627634777600:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 621us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.847487:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1787784683.875982:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784683.876070:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777728 00000100:00100000:3.0:1787784683.876086:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777728 00000100:00100000:3.0:1787784683.876175:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1787784683.876188:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:14476:x1874627634777728:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784683.876217:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784683.876251:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbe6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae28 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876338:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876358:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876420:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784683.876501:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787784683.876506:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784683.876569:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876614:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbe6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae28 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876636:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ee00/0xffb8d925c20bbe73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae28 expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.876647:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784683.876650:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787784683.876654:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269ee00, rc 0) 00000100:00100000:3.0:1787784683.876728:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:14476:x1874627634777728:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 542us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784683.876735:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1787784683.880963:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784683.883082:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634777856 00000100:00100000:1.0:1787784683.883102:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634777856 00000100:00100000:0.0:1787784683.883410:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784683.883424:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:14476:x1874627634777856:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784683.883455:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784683.883481:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbe7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae2f expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883572:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883590:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883613:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883631:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883638:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.883645:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884048:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884092:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884105:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784683.884181:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787784683.884187:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784683.884217:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884231:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884238:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884246:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884253:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee88400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784683.884257:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884264:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884277:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784683.884281:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784683.884286:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884302:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88400/0xffb8d925c20bbe81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884320:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884327:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884333:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884338:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784683.884341:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884348:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884355:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943183fdcb00) 00010000:00010000:0.0:1787784683.884358:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784683.884362:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884495:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bbe88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884539:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbe7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae2f expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884566:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae2f expref: 7 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784683.884573:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943183fdc900) 00010000:00010000:0.0:1787784683.884576:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787784683.884578:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89400, rc 0) 00000100:00100000:0.0:1787784683.884674:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+7:14476:x1874627634777856:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1254us (3727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784683.884685:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1787784683.898479:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.899129:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634778112 00000100:00100000:2.0:1787784683.899139:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634778112 00000100:00100000:2.0:1787784683.899213:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1787784683.899223:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+7:14476:x1874627634778112:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784683.899245:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.899265:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae36 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.899429:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787784683.899554:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae36 expref: 9 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.899570:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:2.0:1787784683.899573:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787784683.899579:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbe96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae36 expref: 9 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.899593:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501200, rc 0) 00000100:00100000:2.0:1787784683.899668:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b419b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+8:14476:x1874627634778112:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 445us (1199us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787784683.899675:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:0.0:1787784683.919695:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.927591:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634778368 00000100:00100000:2.0:1787784683.927619:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634778368 00000100:00100000:2.0:1787784683.927689:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1787784683.927715:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+8:14476:x1874627634778368:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:2.0:1787784683.927848:0:16294:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784683.928653:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89400/0xffb8d925c20bbe8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae2f expref: 8 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.928678:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943183fdc900) 00010000:00010000:2.0:1787784683.928689:0:16294:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784683.928718:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.929506:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.929522:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784683.929770:0:16294:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a065e11 reply state 00000000a22fd46d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784683.929779:0:16294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787784683.929795:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787784683.929892:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba25b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+9:14476:x1874627634778368:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 2177us (10206us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787784683.929914:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:1.0:1787784683.935534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.936153:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634778624 00000100:00100000:2.0:1787784683.936164:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634778624 00000100:00100000:2.0:1787784683.936229:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784683.936239:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+9:14476:x1874627634778624:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784683.936537:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+10:14476:x1874627634778624:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 298us (1013us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787784683.936559:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00010000:00010000:3.0:1787784683.936726:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936749:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936757:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936763:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf501200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784683.936768:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936776:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936803:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1d100) 00010000:00010000:3.0:1787784683.936806:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787784683.936810:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.936816:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbea4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784683.939747:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.939851:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634778880 00000100:00100000:2.0:1787784683.939877:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634778880 00000100:00100000:2.0:1787784683.939984:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:2.0:1787784683.939996:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431ba258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+9:14476:x1874627634778880:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784683.940029:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.940049:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbeab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae3d expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940148:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940164:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940175:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940189:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940196:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.940202:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.940332:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787784683.940576:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940590:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940612:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940620:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784683.940626:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940635:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940654:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784683.940658:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.940665:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940671:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500c00/0xffb8d925c20bbeb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940713:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940719:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940725:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940731:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf500600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:3.0:1787784683.940734:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940741:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940750:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943187f1dd00) 00010000:00010000:3.0:1787784683.940753:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787784683.940756:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940763:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf500600/0xffb8d925c20bbeb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940822:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbeab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae3d expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.940835:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:3.0:1787784683.940837:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787784683.940848:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501c00/0xffb8d925c20bbeab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae3d expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784683.941222:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf501c00, rc 0) 00000100:00100000:3.0:1787784683.941439:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431ba258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+10:14476:x1874627634778880:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1443us (1704us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787784683.941449:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:0.0:1787784683.949722:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.951992:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779008 00000100:00100000:2.0:1787784683.952010:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779008 00000100:00100000:2.0:1787784683.952131:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1787784683.952142:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+10:14476:x1874627634779008:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1787784683.952166:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784683.952193:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbec7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae44 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952281:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952295:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952307:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784683.952355:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787784683.952359:0:14416:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784683.952437:0:14416:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952467:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf501200/0xffb8d925c20bbec7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 12 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952488:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784683.952496:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:2.0:1787784683.952499:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787784683.952503:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1000, rc 0) 00000100:00100000:2.0:1787784683.952578:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+11:14476:x1874627634779008:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 437us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784683.952592:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1787784683.962416:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784683.962583:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779136 00000100:00100000:2.0:1787784683.962595:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779136 00000100:00100000:2.0:1787784683.962674:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1787784683.962685:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+11:14476:x1874627634779136:12345-192.168.202.59@tcp:37:lfs.0 00000100:00100000:1.0:1787784683.967700:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+11:14476:x1874627634779136:12345-192.168.202.59@tcp:37:lfs.0 Request processed in 4999us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784683.967719:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1787784683.971656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784683.971780:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779392 00000100:00100000:1.0:1787784683.971795:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779392 00000100:00100000:1.0:1787784683.972030:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1787784683.972044:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197173050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+11:14476:x1874627634779392:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1787784683.972479:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197173050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+12:14476:x1874627634779392:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 437us (837us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787784683.972512:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1787784684.015596:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.015791:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779520 00000100:00100000:2.0:1787784684.015804:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779520 00000100:00080000:3.0:1787784684.015946:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787784684.016027:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1787784684.016042:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+10:14482:x1874627634779520:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1787784684.016074:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784684.016101:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bbed5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae4b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016300:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016318:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016332:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016348:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016354:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.016361:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.017341:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.017359:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.017499:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784684.017552:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787784684.017556:0:14417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787784684.018144:0:14417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018265:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018273:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018282:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018289:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784684.018295:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018305:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018323:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784684.018327:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784684.018333:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018341:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0e00/0xffb8d925c20bbedc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018362:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018573:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018579:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018592:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1e00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784684.018595:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018619:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018629:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff943187f1da00) 00010000:00010000:0.0:1787784684.018632:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784684.018635:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018641:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1e00/0xffb8d925c20bbee3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018697:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1a00/0xffb8d925c20bbed5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae4b expref: 12 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018714:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89c00/0xffb8d925c20bbeea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae4b expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.018722:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:0.0:1787784684.018725:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787784684.018727:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89c00, rc 0) 00000100:00100000:0.0:1787784684.018845:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14482:x1874627634779520:12345-192.168.202.59@tcp:101:bash.0 Request processed in 2806us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.018970:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000040:00080000:1.0:1787784684.021160:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787784684.023533:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.023887:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779776 00000100:00100000:3.0:1787784684.023904:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779776 00000100:00100000:3.0:1787784684.023993:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:3.0:1787784684.024007:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14482:x1874627634779776:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784684.024040:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784684.024070:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbef1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae52 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.024467:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.024488:0:16294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.024499:0:16294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.024543:0:16294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.024559:0:16294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 11 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784684.024587:0:16294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643161472:192.168.202.59@tcp:104: 00000100:00100000:0.0:1787784684.027398:0:16294:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431843a3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787784684.033585:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784684.033822:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634779904 00000100:00100000:1.0:1787784684.033849:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634779904 00010000:00010000:1.0:1787784684.033934:0:16535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 12 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784684.033987:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1787784684.033999:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+12:2362:x1874627634779904:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787784684.034020:0:16535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787784684.034028:0:16535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 12 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.034044:0:16535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 12 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.034072:0:16535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:1.0:1787784684.034078:0:16535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.034090:0:16535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.034100:0:16535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.034128:0:16535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787784684.034202:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+12:2362:x1874627634779904:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 204us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.034229:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00010000:00010000:2.0:1787784684.034779:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbece lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae44 expref: 11 pid: 14416 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784684.034803:0:16294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643161472:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784684.034846:0:16294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.034867:0:16294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.034874:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.034905:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.034917:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.034927:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787784684.036628:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787784684.036853:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.036886:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.036899:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784684.036936:0:16294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787784684.036977:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.036986:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.036994:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037002:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269ec00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784684.037007:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037017:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037033:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:2.0:1787784684.037037:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784684.037043:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037050:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbef8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787784684.037065:0:16294:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080ab9828 reply state 0000000040e56d33 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784684.037075:0:16294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787784684.037125:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbef1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 14 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037288:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 13 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.037299:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.037301:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787784684.037304:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f0200, rc 0) 00000100:00100000:2.0:1787784684.037435:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14482:x1874627634779776:12345-192.168.202.59@tcp:101:bash.0 Request processed in 13429us (13917us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787784684.037446:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00010000:00010000:2.0:1787784684.043931:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.043956:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.043966:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.043974:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1600 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784684.043980:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.043989:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.044010:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff943187f1db00) 00010000:00010000:2.0:1787784684.044014:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784684.044020:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.044048:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbeff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784684.049825:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.049982:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634780032 00000100:00100000:3.0:1787784684.049996:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634780032 00000100:00100000:3.0:1787784684.050075:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:3.0:1787784684.050089:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+13:14482:x1874627634780032:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1787784684.050123:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784684.050165:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf14 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae59 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050261:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050278:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050291:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784684.050342:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787784684.050347:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787784684.050431:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050445:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050476:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf14 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050519:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 14 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.050530:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:3.0:1787784684.050533:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784684.050538:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269fe00, rc 0) 00000100:00100000:3.0:1787784684.050623:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14482:x1874627634780032:12345-192.168.202.59@tcp:101:bash.0 Request processed in 537us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.050633:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1787784684.058214:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.058311:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634780288 00000100:00100000:2.0:1787784684.058325:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634780288 00000100:00100000:2.0:1787784684.058440:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1787784684.058455:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14482:x1874627634780288:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:2.0:1787784684.059014:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:14482:x1874627634780288:12345-192.168.202.59@tcp:35:bash.0 Request processed in 560us (816us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787784684.059024:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784684.142305:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784684.142496:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634780544 00000100:00100000:0.0:1787784684.142509:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634780544 00000100:00100000:0.0:1787784684.142588:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784684.142632:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:14492:x1874627634780544:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1787784684.142668:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784684.142697:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbf22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae60 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784684.142874:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787784684.143047:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbf22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae60 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.143064:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff943190486c00) 00010000:00010000:0.0:1787784684.143068:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784684.143074:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbf22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae60 expref: 17 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.143095:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89800, rc 0) 00000100:00100000:0.0:1787784684.143192:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf673c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:14492:x1874627634780544:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 594us (903us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787784684.143201:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784684.146848:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.146975:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634780800 00000100:00100000:2.0:1787784684.146991:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634780800 00000100:00100000:2.0:1787784684.147066:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1787784684.147078:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:14492:x1874627634780800:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784684.147491:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14492:x1874627634780800:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 414us (657us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787784684.147499:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784684.184644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.184790:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634781056 00000100:00100000:3.0:1787784684.184806:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634781056 00000100:00100000:3.0:1787784684.184905:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:3.0:1787784684.184920:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14495:x1874627634781056:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1787784684.184959:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784684.184990:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae67 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.185139:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f200/0xffb8d925c20bbf37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.185543:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f200/0xffb8d925c20bbf37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.185561:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f200/0xffb8d925c20bbf37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787784684.185576:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787784684.185795:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae67 expref: 20 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.185819:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f200/0xffb8d925c20bbf37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae67 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.185828:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:3.0:1787784684.185832:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787784684.185836:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269f200, rc 0) 00000100:00100000:3.0:1787784684.186107:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:14495:x1874627634781056:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1189us (1479us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787784684.186118:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:0.0:1787784684.189422:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784684.189467:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.189563:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634781184 00000100:00100000:2.0:1787784684.189574:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634781184 00000100:00100000:2.0:1787784684.189665:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1787784684.189676:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:2362:x1874627634781184:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784684.189694:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784684.189728:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f200/0xffb8d925c20bbf37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae67 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.189772:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.189778:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784684.189842:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:2362:x1874627634781184:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 168us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.189850:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784684.190080:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634781312 00000100:00100000:1.0:1787784684.190084:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634781312 00000100:00100000:1.0:1787784684.190123:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1787784684.190130:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14495:x1874627634781312:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:1.0:1787784684.190291:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190311:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190323:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190357:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190488:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190496:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190503:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:1.0:1787784684.190509:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190530:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190541:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:1.0:1787784684.190544:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787784684.190549:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.190556:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784684.191016:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14495:x1874627634781312:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 883us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.191023:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:0.0:1787784684.193318:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.193469:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634781568 00000100:00100000:2.0:1787784684.193483:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634781568 00000100:00100000:2.0:1787784684.193538:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1787784684.193548:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14495:x1874627634781568:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1787784684.194313:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:14495:x1874627634781568:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 761us (1002us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787784684.194323:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1787784684.341565:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787784684.341733:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787784684.341767:0:3294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643161984:0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.341883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784684.341997:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161984 00000100:00100000:2.0:1787784684.342007:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161984 00000100:00100000:2.0:1787784684.342085:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787784684.342095:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643161984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342170:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1874627643161984:12345-0@lo:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.342177:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787784684.342203:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787784684.342240:0:3294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3294:1874627643161984:0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342300:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643161728:0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784684.342409:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787784684.342415:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643161856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342441:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784684.342468:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161856 00000100:00100000:2.0:1787784684.342472:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161856 00000100:00100000:2.0:1787784684.342501:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787784684.342507:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643161856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342544:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf699680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1874627643161856:12345-0@lo:400:kworker.0 Request processed in 38us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.342550:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787784684.342562:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787784684.342578:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3295:1874627643161856:0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342628:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161728 00000100:00100000:2.0:1787784684.342632:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161728 00000100:00100000:2.0:1787784684.342661:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787784684.342668:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643161728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787784684.342702:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:459db144-24ce-4979-944c-65e392f5ff2a+19:3295:x1874627643161728:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.342708:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787784684.342741:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:459db144-24ce-4979-944c-65e392f5ff2a:3295:1874627643161728:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.350513:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff94319206fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643161600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787784684.350647:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787784684.350832:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643161600 00000100:00100000:3.0:1787784684.350844:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643161600 00000100:00100000:3.0:1787784684.350932:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787784684.350944:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643161600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787784684.351000:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787784684.351066:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643161600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.351074:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787784684.351299:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff94319206fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643161600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787784684.351524:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643162240:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.351568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.351606:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787784684.351613:0:3295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643162368:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.351638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787784684.351669:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643162240 00000100:00100000:0.0:1787784684.351673:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643162240 00000100:00080000:0.0:1787784684.351699:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784684.351731:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643162368 00000100:00100000:0.0:1787784684.351734:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643162368 00000100:00080000:0.0:1787784684.351746:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787784684.351766:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784684.351773:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643162240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.351813:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1874627643162240:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784684.351820:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787784684.351846:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3295:1874627643162240:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.351946:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787784684.351955:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431b3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643162112:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.351984:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784684.352008:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643162112 00000100:00100000:1.0:1787784684.352011:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643162112 00000100:00100000:1.0:1787784684.352033:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784684.352040:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643162368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.352071:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1874627643162368:12345-0@lo:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.352100:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787784684.352112:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784684.352117:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643162112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.352164:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1874627643162112:12345-0@lo:400:kworker.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784684.352170:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787784684.352194:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3293:1874627643162112:0@lo:400:kworker.0 00000100:00100000:0.0:1787784684.352507:0:3295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431b3fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3295:1874627643162368:0@lo:400:kworker.0 00000100:00100000:1.0:1787784684.435729:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.436071:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634781824 00000100:00100000:2.0:1787784684.436085:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634781824 00000100:00100000:2.0:1787784684.436279:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1787784684.436294:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:14526:x1874627634781824:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1787784684.436333:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784684.436429:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbf4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae6e expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.436563:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbf53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.436584:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbf53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.436615:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbf53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784684.436630:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787784684.436825:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1600/0xffb8d925c20bbf4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae6e expref: 22 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.437029:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbf53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae6e expref: 21 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.437040:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.437043:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787784684.437048:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1000, rc 0) 00000100:00100000:2.0:1787784684.437225:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf670b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+21:14526:x1874627634781824:12345-192.168.202.59@tcp:101:cat.0 Request processed in 934us (1508us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787784684.437234:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1787784684.442915:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784684.443198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784684.443649:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782080 00000100:00100000:1.0:1787784684.443662:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782080 00000100:00100000:1.0:1787784684.443740:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1787784684.443753:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+21:14526:x1874627634782080:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:1.0:1787784684.444585:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+22:14526:x1874627634782080:12345-192.168.202.59@tcp:35:cat.0 Request processed in 828us (1679us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787784684.444614:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1787784684.445025:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782208 00000100:00100000:2.0:1787784684.445033:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782208 00000100:00100000:2.0:1787784684.445153:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1787784684.445165:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+22:2362:x1874627634782208:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784684.445203:0:16535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784684.445250:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1000/0xffb8d925c20bbf53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae6e expref: 22 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.445283:0:16535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.445291:0:16535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784684.445338:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+21:2362:x1874627634782208:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 176us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.445346:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00010000:00010000:0.0:1787784684.469409:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787784684.512498:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784684.512648:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782464 00000100:00100000:1.0:1787784684.512663:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782464 00000100:00100000:1.0:1787784684.512746:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1787784684.512759:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+21:14532:x1874627634782464:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:1.0:1787784684.512795:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784684.512822:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae75 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.512989:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513029:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 22 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513039:0:14417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 22 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513049:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513095:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 22 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513112:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 22 pid: 14415 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784684.513129:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643162496:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784684.513813:0:14417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 22 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784684.513826:0:14417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 22 pid: 16294 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784684.513837:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643162624:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784684.515636:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318858f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787784684.517879:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.517931:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784684.518196:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643162496:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784684.518213:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf671680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14417:1874627643162624:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784684.518265:0:14417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784684.518661:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782720 00000100:00100000:0.0:1787784684.518672:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782720 00010000:00010000:0.0:1787784684.518728:0:14401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 23 pid: 16294 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784684.518776:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782592 00000100:00100000:0.0:1787784684.518788:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782592 00010000:00010000:0.0:1787784684.518803:0:14401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 24 pid: 14415 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784684.520340:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1787784684.520385:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b299c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+24:2363:x1874627634782720:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784684.520412:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784684.520425:0:14401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 24 pid: 16294 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.520443:0:14401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 24 pid: 16294 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.520477:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0200/0xffb8d925c20bbf06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae52 expref: 24 pid: 16294 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.520500:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:0.0:1787784684.520507:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.520518:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.520525:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787784684.520625:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b299c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:2363:x1874627634782720:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 268us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.521056:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1787784684.521073:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:2363:x1874627634782592:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784684.521086:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784684.521092:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 23 pid: 14415 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521104:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 23 pid: 14415 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521120:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269fe00/0xffb8d925c20bbf1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae59 expref: 23 pid: 14415 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521133:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.521139:0:14402:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521158:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521184:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521224:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784684.521254:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+22:2363:x1874627634782592:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 188us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.521263:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:2.0:1787784684.521563:0:14417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521573:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784684.521618:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787784684.521873:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512000/0xffb8d925c20bbf61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae75 expref: 23 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521893:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512600/0xffb8d925c20bbf68 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae75 expref: 22 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.521901:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.521905:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787784684.521907:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512600, rc 0) 00000100:00100000:2.0:1787784684.521956:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+22:14532:x1874627634782464:12345-192.168.202.59@tcp:101:dd.0 Request processed in 9199us (9474us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787784684.521964:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:2.0:1787784684.524983:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.525741:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634782976 00000100:00100000:3.0:1787784684.525757:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634782976 00000100:00100000:3.0:1787784684.525838:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1787784684.525859:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+22:14532:x1874627634782976:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:3.0:1787784684.526268:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.526311:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.526327:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784684.526440:0:16294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787784684.526489:0:16294:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000442ff750 reply state 00000000d0538cab transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784684.526501:0:16294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784684.526657:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+25:14532:x1874627634782976:12345-192.168.202.59@tcp:36:dd.0 Request processed in 807us (1688us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787784684.526666:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000020:00080000:3.0:1787784684.526672:0:16294:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787784684.529795:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784684.531154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.531463:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783104 00000100:00100000:3.0:1787784684.531476:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783104 00000100:00100000:3.0:1787784684.531539:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1787784684.531551:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+24:14532:x1874627634783104:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:3.0:1787784684.531585:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784684.531629:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae7c expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.531713:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae7c expref: 25 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.531729:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae7c expref: 25 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.531769:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:3.0:1787784684.531773:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784684.531778:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269f600, rc 0) 00000100:00100000:3.0:1787784684.531867:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf698f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+25:14532:x1874627634783104:12345-192.168.202.59@tcp:101:dd.0 Request processed in 318us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.531875:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00010000:00010000:0.0:1787784684.536561:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536613:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536622:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536628:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269f800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784684.536634:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536643:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536665:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:0.0:1787784684.536668:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784684.536674:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784684.536680:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f800/0xffb8d925c20bbf76 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784684.546608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784684.546756:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783360 00000100:00100000:2.0:1787784684.546770:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783360 00000100:00100000:2.0:1787784684.546871:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784684.546884:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+24:14532:x1874627634783360:12345-192.168.202.59@tcp:103:dd.0 00010000:00010000:2.0:1787784684.546907:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784684.546943:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f600/0xffb8d925c20bbf7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae7c expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784684.546970:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784684.546978:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784684.547061:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:14532:x1874627634783360:12345-192.168.202.59@tcp:103:dd.0 Request processed in 179us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784684.547070:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:1.0:1787784684.550065:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.550249:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783488 00000100:00100000:3.0:1787784684.550262:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783488 00000100:00100000:3.0:1787784684.550410:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:3.0:1787784684.550423:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:14532:x1874627634783488:12345-192.168.202.59@tcp:58:dd.0 00010000:00010000:3.0:1787784684.550745:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.550769:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.550783:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787784684.552708:0:16294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787784684.552979:0:16294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787784684.553067:0:16294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787784684.553398:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:14532:x1874627634783488:12345-192.168.202.59@tcp:58:dd.0 Request processed in 2944us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.553413:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1787784684.555961:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784684.556074:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783616 00000100:00100000:3.0:1787784684.556109:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783616 00000100:00100000:3.0:1787784684.556251:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1787784684.556264:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+23:14532:x1874627634783616:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:3.0:1787784684.556293:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787784684.556321:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae83 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556451:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556465:0:14415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556493:0:14415:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556510:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556526:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:3.0:1787784684.556530:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787784684.556534:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784684.556544:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94308269e400, rc 0) 00000100:00100000:3.0:1787784684.557340:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+24:14532:x1874627634783616:12345-192.168.202.59@tcp:101:dd.0 Request processed in 1071us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784684.557352:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000001:00080000:0.0:1787784684.928918:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934602 is committed 00000001:00080000:0.0:1787784684.928950:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:0.0:1787784684.928957:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787784684.928964:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1787784684.928998:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000040:00080000:2.0:1787784685.044961:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787784685.044977:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787784685.045028:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787784685.045041:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787784685.045292:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1874627643162752:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787784685.045497:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318851ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787784685.055746:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.055907:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9431bf69b840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1874627643162752:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787784685.056249:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783744 00000100:00100000:3.0:1787784685.056259:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783744 00000100:00100000:3.0:1787784685.056331:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1787784685.056343:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf6721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634783744:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787784685.056490:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf6721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634783744:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 Request processed in 148us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.056499:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1787784685.058623:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.063417:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634783872 00000100:00100000:2.0:1787784685.063440:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634783872 00000100:00100000:2.0:1787784685.063550:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1787784685.063563:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634783872:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787784685.063620:0:14416:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787784685.063794:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634783872:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 233us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.063825:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:1.0:1787784685.067780:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.067846:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634784000 00000100:00100000:2.0:1787784685.067860:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634784000 00000100:00100000:2.0:1787784685.067942:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1787784685.067956:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634784000:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787784685.068066:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068090:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068105:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068360:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068458:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068472:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068508:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068517:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068524:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784685.068600:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787784685.068606:0:14417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784685.068623:0:14417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068635:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068650:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068656:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068662:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.068667:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068674:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068687:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943187f1d000) 00010000:00010000:2.0:1787784685.068690:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784685.068694:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068700:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1200/0xffb8d925c20bbf92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068715:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068731:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068738:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068742:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.068745:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068751:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068759:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff943187f1dd00) 00010000:00010000:2.0:1787784685.068761:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784685.068764:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068770:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbf99 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068786:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068792:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068797:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068801:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.068811:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068818:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068826:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784685.068828:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784685.068832:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.068837:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfa0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.068959:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf671e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634784000:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 1002us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.068970:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:1.0:1787784685.072724:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.076667:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634784256 00000100:00100000:2.0:1787784685.076686:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634784256 00000100:00100000:0.0:1787784685.076901:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1787784685.076918:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:14534:x1874627634784256:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784685.076950:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784685.076999:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfa7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae8a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077154:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077173:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077187:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787784685.077201:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787784685.077429:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077439:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077445:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077452:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89200 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784685.077456:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077464:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077480:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:0.0:1787784685.077483:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787784685.077488:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077575:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89200/0xffb8d925c20bbfae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077653:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfa7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae8a expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077666:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff943187f1d000) 00010000:00010000:0.0:1787784685.077669:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787784685.077673:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfa7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae8a expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.077685:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88e00, rc 0) 00000100:00100000:0.0:1787784685.077789:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf672580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14534:x1874627634784256:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 872us (5076us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787784685.077798:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:3.0:1787784685.083803:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.084357:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634784384 00000100:00100000:1.0:1787784685.084428:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634784384 00000100:00100000:1.0:1787784685.084525:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1787784685.084538:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14534:x1874627634784384:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787784685.084786:0:14415:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787784685.085274:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14534:x1874627634784384:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 735us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784685.085284:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:3.0:1787784685.094280:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.094493:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634784640 00000100:00100000:0.0:1787784685.094518:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634784640 00000100:00100000:0.0:1787784685.094602:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:0.0:1787784685.094615:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:14534:x1874627634784640:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784685.094647:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784685.094674:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbfbc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae91 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787784685.097121:0:14416:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787784685.097219:0:14416:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787784685.097282:0:14416:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787784685.099149:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.099198:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.099213:0:14416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14416 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.099307:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbfbc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae91 expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.099333:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae91 expref: 14 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.099344:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:0.0:1787784685.099347:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787784685.099352:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee88e00, rc 0) 00000100:00100000:0.0:1787784685.099493:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634784640:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4879us (5230us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787784685.099513:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1787784685.103276:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.103789:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634784896 00000100:00100000:2.0:1787784685.103803:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634784896 00000100:00100000:2.0:1787784685.103890:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:2.0:1787784685.103903:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634784896:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787784685.103992:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784685.104031:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee88e00/0xffb8d925c20bbfc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae91 expref: 14 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104055:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943183fdcb00) 00010000:00010000:2.0:1787784685.104069:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784685.104103:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104153:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104166:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104185:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104193:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.104200:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105093:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105108:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105117:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105123:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1800 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.105129:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105693:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105717:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff943187f1de00) 00010000:00010000:2.0:1787784685.105732:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784685.105739:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105747:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bbfd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105764:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105771:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105777:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105782:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.105785:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105792:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105800:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd4b234b7 (ffff943187f1dd00) 00010000:00010000:2.0:1787784685.105802:0:14417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787784685.105805:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.105811:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbfd8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd4b234b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.108419:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b45b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+13:14534:x1874627634784896:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 4450us (5088us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787784685.108459:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1787784685.114347:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.114501:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634785024 00000100:00100000:1.0:1787784685.114526:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634785024 00000100:00100000:1.0:1787784685.114606:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:1.0:1787784685.114619:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+13:14534:x1874627634785024:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787784685.114649:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787784685.114682:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbfdf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae98 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114728:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512800/0xffb8d925c20bbfe6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114765:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181512800/0xffb8d925c20bbfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114778:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181512800/0xffb8d925c20bbfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114928:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181512a00/0xffb8d925c20bbfdf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae98 expref: 15 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114951:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff943181512800/0xffb8d925c20bbfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae98 expref: 14 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.114961:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:1.0:1787784685.114964:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787784685.114969:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff943181512800, rc 0) 00000100:00100000:1.0:1787784685.115048:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94319206c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634785024:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 432us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784685.115057:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1787784685.118416:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.119609:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634785280 00000100:00100000:1.0:1787784685.119626:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634785280 00000100:00100000:1.0:1787784685.119708:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:1.0:1787784685.119720:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634785280:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787784685.119845:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.119874:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.119910:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787784685.120557:0:14415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787784685.120572:0:14415:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499947206090ns, next at 500947203010ns, rc = 0 00000004:00010000:1.0:1787784685.120704:0:14415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ee479bc reply state 00000000b31d323d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.120717:0:14415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787784685.120869:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:14534:x1874627634785280:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1147us (2499us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787784685.120878:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00010000:00010000:0.0:1787784685.127350:0:3279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127391:0:3279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127402:0:3279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127408:0:3279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784685.127414:0:3279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127446:0:3279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127471:0:3279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:0.0:1787784685.127475:0:3279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787784685.127480:0:3279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.127486:0:3279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513400/0xffb8d925c20bbfed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.130341:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.130511:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634785408 00000100:00100000:0.0:1787784685.130527:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634785408 00000100:00100000:0.0:1787784685.130615:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:0.0:1787784685.130626:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:14534:x1874627634785408:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787784685.130662:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787784685.130692:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849ae9f expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.130774:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.130791:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.130816:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:0.0:1787784685.130820:0:14416:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787784685.130825:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bee89800, rc 0) 00000100:00100000:0.0:1787784685.130926:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:14534:x1874627634785408:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 302us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784685.130935:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1787784685.140439:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.140547:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634785536 00000100:00100000:3.0:1787784685.140562:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634785536 00000100:00100000:3.0:1787784685.140656:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1787784685.140669:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634785536:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787784685.141152:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2364:x1874627634785536:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 483us (726us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787784685.141161:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00080000:0.0:1787784685.141250:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787784685.148123:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.148672:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634785792 00000100:00100000:2.0:1787784685.148688:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634785792 00000100:00100000:2.0:1787784685.148772:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1787784685.148784:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:14534:x1874627634785792:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787784685.149128:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14534:x1874627634785792:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 344us (1019us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787784685.149138:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1787784685.152047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.152742:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786048 00000100:00100000:3.0:1787784685.152757:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786048 00000100:00100000:3.0:1787784685.152842:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1787784685.152862:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14534:x1874627634786048:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784685.153025:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14534:x1874627634786048:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 172us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.153052:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:1.0:1787784685.156246:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.156358:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786176 00000100:00100000:3.0:1787784685.156498:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786176 00000100:00100000:2.0:1787784685.156672:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:2.0:1787784685.156695:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:14534:x1874627634786176:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784685.156724:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784685.156753:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbffb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aea6 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.156846:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.158662:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.158691:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787784685.158755:0:16294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787784685.158783:0:16294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.158864:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1400/0xffb8d925c20bbffb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aea6 expref: 19 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.158890:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aea6 expref: 18 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.158901:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:2.0:1787784685.158904:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787784685.158909:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1800, rc 0) 00000100:00100000:2.0:1787784685.159012:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634786176:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2319us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.159022:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1787784685.166300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.166416:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786304 00000100:00100000:2.0:1787784685.166430:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786304 00000100:00100000:2.0:1787784685.166505:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784685.166518:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+6:2362:x1874627634786304:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787784685.166545:0:15101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787784685.166573:0:15101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x845202732849aead expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787784685.166618:0:15101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6ded, blocks: 0x1 00010000:00010000:2.0:1787784685.166647:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=499s v=(0 0) 00010000:00010000:2.0:1787784685.166653:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.166666:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 7 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.166720:0:15101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 7 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.166735:0:15101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9431bf7f1400, rc 0) 00000100:00100000:2.0:1787784685.166825:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2362:x1874627634786304:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 309us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.166834:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1787784685.170348:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.170644:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786560 00000100:00100000:3.0:1787784685.170658:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786560 00000100:00100000:3.0:1787784685.170734:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1787784685.170745:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634786560:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787784685.170906:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634786560:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 161us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.170915:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1787784685.175248:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.175977:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786688 00000100:00100000:0.0:1787784685.175990:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786688 00000100:00100000:0.0:1787784685.176106:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784685.176119:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634786688:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787784685.247749:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1787784685.247777:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787784685.247783:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787784685.247806:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1787784685.248194:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431891603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634786688:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 72067us (72951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.248208:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1787784685.249401:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643162880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787784685.249491:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784685.250339:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643162880 00000100:00100000:1.0:1787784685.250351:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643162880 00000100:00100000:1.0:1787784685.250438:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784685.250447:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643162880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787784685.250673:0:15102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787784685.250810:0:15102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787784685.250813:0:15102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787784685.250816:0:15102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787784685 -> 1787784685 00002000:00010000:1.0:1787784685.250819:0:15102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787784685.251109:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.251173:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1874627643162880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 726us (1681us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787784685.251201:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787784685.251222:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634786816 00000100:00100000:1.0:1787784685.251226:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634786816 00000100:00100000:1.0:1787784685.251257:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1787784685.251263:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2363:x1874627634786816:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787784685.251341:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2363:x1874627634786816:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784685.251348:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000004:00080000:3.0:1787784685.252228:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff943189161e00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787784685.252242:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189161e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643162880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787784685.256025:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.256210:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787072 00000100:00100000:3.0:1787784685.256225:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787072 00000100:00100000:3.0:1787784685.256344:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1787784685.256357:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634787072:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787784685.256460:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787784685.256503:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f1800/0xffb8d925c20bc002 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aea6 expref: 14 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.256529:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:3.0:1787784685.256537:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787784685.256616:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.256637:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.256651:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787784685.257014:0:14415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039027923 reply state 000000005f5b5d7c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.257025:0:14415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787784685.264274:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:14534:x1874627634787072:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 7896us (8244us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787784685.264293:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00010000:00010000:0.0:1787784685.271882:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.271910:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.271921:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.271928:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269f400 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784685.271934:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.271972:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.271999:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:0.0:1787784685.272002:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784685.272009:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.272016:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269f400/0xffb8d925c20bc010 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.282053:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.282321:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787200 00000100:00100000:1.0:1787784685.282337:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787200 00000100:00100000:1.0:1787784685.282448:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784685.282461:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2363:x1874627634787200:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787784685.282734:0:15102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787784685.282738:0:15102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787784684 00002000:00010000:1.0:1787784685.282742:0:15102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787784684 00002000:00010000:1.0:1787784685.282744:0:15102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787784685 -> 1787784684 00002000:00010000:1.0:1787784685.282747:0:15102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787784685.282829:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431bf69b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+8:2363:x1874627634787200:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 370us (793us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787784685.282838:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:1.0:1787784685.291339:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.291490:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787328 00000100:00100000:3.0:1787784685.291567:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787328 00000100:00100000:2.0:1787784685.291839:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784685.291857:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+8:2362:x1874627634787328:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787784685.291922:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.291946:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787784685.291951:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.291959:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.291979:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292023:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292056:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292066:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292075:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f1c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784685.292080:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292091:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292111:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.292120:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c36bba5/0xffb8d925c20bc017 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.292733:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+8:2362:x1874627634787328:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 878us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.292745:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1787784685.297421:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.297566:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787584 00000100:00100000:1.0:1787784685.297581:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787584 00000100:00100000:1.0:1787784685.297673:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1787784685.297700:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:14534:x1874627634787584:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787784685.297843:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.297867:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.297882:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.299045:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.299073:0:16294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.299083:0:16294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.299131:0:16294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 15 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.299319:0:16294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 15 pid: 14416 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.299339:0:16294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643163008:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784685.299647:0:16294:0:(client.c:2715:ptlrpc_set_wait()) set ffff9431850140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787784685.315336:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.315545:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787712 00000100:00100000:0.0:1787784685.315557:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787712 00010000:00010000:0.0:1787784685.315628:0:14401:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784685.315695:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1787784685.315708:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:2363:x1874627634787712:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787784685.315728:0:14401:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787784685.315737:0:14401:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.315755:0:14401:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.315786:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:0.0:1787784685.315793:0:14401:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.315827:0:14401:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.315838:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.315865:0:14401:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787784685.316044:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89800/0xffb8d925c20bbff4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849ae9f expref: 16 pid: 14416 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.316086:0:16294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643163008:192.168.202.59@tcp:104: 00010000:00010000:2.0:1787784685.316113:0:16294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.316124:0:16294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.316130:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784685.316433:0:16294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787784685.316633:0:16294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787784685.316702:0:16294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787784685.316807:0:16294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d270c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16294:1874627643163136:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784685.317125:0:16294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784685.317178:0:16294:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318851a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787784685.317242:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643163136 00000100:00100000:3.0:1787784685.317252:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643163136 00000100:00100000:3.0:1787784685.317308:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787784685.317321:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16294:x1874627643163136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784685.317462:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16294:x1874627643163136:12345-0@lo:1000:mdt00_003.0 Request processed in 144us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784685.317471:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787784685.317805:0:16294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d270c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16294:1874627643163136:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787784685.319066:0:16294:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787784685.319163:0:16294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d270c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16294:1874627643163264:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787784685.319244:0:16294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787784685.319283:0:16294:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318851a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787784685.319408:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643163264 00000100:00100000:3.0:1787784685.319420:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643163264 00000100:00100000:3.0:1787784685.319484:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787784685.319495:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16294:x1874627643163264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787784685.319791:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16294:x1874627643163264:12345-0@lo:1000:mdt00_003.0 Request processed in 296us (545us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787784685.319814:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787784685.319882:0:16294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d270c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16294:1874627643163264:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787784685.319923:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.319935:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.319954:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.319960:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.319964:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320090:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320110:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:2.0:1787784685.320113:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784685.320118:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320125:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513000/0xffb8d925c20bc025 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320161:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320169:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320175:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320180:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269ec00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:2.0:1787784685.320183:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320200:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320208:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:2.0:1787784685.320211:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787784685.320332:0:16294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320347:0:16294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320356:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.320415:0:16294:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94308269e400/0xffb8d925c20bbf8b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849ae83 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.320617:0:16294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643163392:192.168.202.59@tcp:105: 00000100:00100000:0.0:1787784685.324038:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189163840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:2363:x1874627634787712:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 8311us (8697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787784685.324059:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1787784685.328662:0:16294:0:(client.c:2715:ptlrpc_set_wait()) set ffff94318851a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787784685.340726:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.340949:0:16294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943081d25a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16294:1874627643163392:192.168.202.59@tcp:105: 00010000:00010000:0.0:1787784685.340994:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341007:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94308269ec00/0xffb8d925c20bbf84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341054:0:16294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341073:0:16294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341089:0:16294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341103:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341110:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341149:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341158:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bee89000 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784685.341164:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.341166:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634787840 00010000:00010000:0.0:1787784685.341181:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.341185:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634787840 00010000:00010000:0.0:1787784685.341199:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:0.0:1787784685.341209:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787784685.341213:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341221:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bee89000/0xffb8d925c20bc02c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341240:0:16294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341248:0:16294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341254:0:16294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341259:0:16294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513c00 already unused, calling callback (ffffffffc203b4f0) 00010000:00010000:0.0:1787784685.341262:0:16294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341280:0:16294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341291:0:16294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff943187f1da00) 00010000:00010000:0.0:1787784685.341294:0:16294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787784685.341298:0:16294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.341306:0:16294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff943181513c00/0xffb8d925c20bc01e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.341310:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1787784685.341334:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943197171850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:14532:x1874627634787840:12345-192.168.202.59@tcp:49:dd.0 00000100:00100000:1.0:1787784685.341568:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943197171850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:14532:x1874627634787840:12345-192.168.202.59@tcp:49:dd.0 Request processed in 243us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784685.341577:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000040:00080000:0.0:1787784685.341984:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787784685.341992:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787784685.342028:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787784685.342034:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787784685.342149:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634787584:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 44449us (44779us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787784685.342160:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000020:00080000:0.0:1787784685.342165:0:16294:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787784685.344820:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.368582:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788096 00000100:00100000:2.0:1787784685.368611:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788096 00000100:00100000:2.0:1787784685.368683:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1787784685.368695:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:14534:x1874627634788096:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787784685.369493:0:14419:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787784685.371146:0:14419:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787784685.371232:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371250:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371262:0:14419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371270:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371277:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371283:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.371305:0:14419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787784685.371469:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+20:14534:x1874627634788096:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 2773us (26659us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787784685.371479:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000020:00080000:2.0:1787784685.371484:0:14419:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787784685.371853:0:14405:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787784685.371869:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.371881:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0a00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784685.371886:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.371897:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.371937:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff943190486400) 00010000:00010000:0.0:1787784685.371940:0:14405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787784685.371946:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.371952:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9431bf7f0a00/0xffb8d925c20bc033 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14419 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.371970:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784685.371972:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784685.371973:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784685.492643:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787784685.580492:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.580534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.580977:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788352 00000100:00100000:1.0:1787784685.580997:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788352 00000100:00100000:1.0:1787784685.581066:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788224 00000100:00100000:1.0:1787784685.581071:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788224 00000100:00100000:1.0:1787784685.581092:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784685.581102:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+9:2364:x1874627634788352:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:1.0:1787784685.581137:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.581157:0:15105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 9 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.581165:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.581170:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.581174:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.581207:0:15105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 9 pid: 15101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.581229:0:15105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 9 pid: 15101 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.581266:0:15105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189160780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15105:1874627643163520:192.168.202.59@tcp:104: 00000100:00100000:1.0:1787784685.581388:0:15105:0:(client.c:2715:ptlrpc_set_wait()) set ffff943185014d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787784685.587481:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1787784685.587526:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1787784685.587846:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787784685.587856:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787784685.588282:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784685.588295:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788608 00000100:00100000:3.0:1787784685.588304:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788608 00000100:00100000:3.0:1787784685.588347:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784685.588351:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788480 00000100:00100000:3.0:1787784685.588353:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788480 00000100:00100000:1.0:1787784685.588873:0:15105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189160780 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15105:1874627643163520:192.168.202.59@tcp:104: 00010000:00010000:1.0:1787784685.588900:0:15105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.593451:0:16648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:3.0:1787784685.593471:0:16648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:2364:x1874627634788224:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:3.0:1787784685.593516:0:16648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.593550:0:16648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.593556:0:16648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.593561:0:16648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.593572:0:16648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.593875:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1787784685.593980:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.595025:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787784685.595042:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787784685.595426:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788864 00000100:00100000:2.0:1787784685.595437:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788864 00010000:00010000:2.0:1787784685.595473:0:14402:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 12 pid: 15101 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.595509:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1787784685.595528:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2363:x1874627634788864:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787784685.595555:0:14402:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787784685.595579:0:14402:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 12 pid: 15101 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595604:0:14402:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 12 pid: 15101 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595627:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f86c9a9/0xffb8d925c20bc009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x845202732849aead expref: 12 pid: 15101 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595642:0:14402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.595646:0:14402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.595651:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595660:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595669:0:14402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.595672:0:14402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.595675:0:14402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595682:0:14402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.595735:0:14402:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787784685.595791:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189160780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+11:2363:x1874627634788864:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 264us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784685.595800:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00010000:00010000:0.0:1787784685.595928:0:16648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.595938:0:16648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.597322:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788736 00000100:00100000:1.0:1787784685.597333:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788736 00000100:00100000:1.0:1787784685.599045:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:1.0:1787784685.599071:0:16649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c50cf92d-6067-4c10-bfbc-11c55aeaf749+12:2364:x1874627634788608:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:1.0:1787784685.599125:0:16649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.599145:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.599149:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.599156:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.599173:0:16649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.600482:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.600557:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.600580:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787784685.600607:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1787784685.600730:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784685.600822:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634788992 00000100:00100000:3.0:1787784685.600831:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634788992 00000100:00100000:3.0:1787784685.600882:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787784685.600889:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789120 00000100:00100000:3.0:1787784685.600891:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789120 00000100:00100000:3.0:1787784685.600905:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787784685.600910:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789248 00000100:00100000:3.0:1787784685.600912:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789248 00000100:00100000:3.0:1787784685.601301:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1787784685.601311:0:16650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:2364:x1874627634788480:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:3.0:1787784685.601347:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.601396:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.601401:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.601408:0:16650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.601422:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.607107:0:15105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.607130:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787784685.735194:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1787784685.735246:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1787784685.735260:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1787784685.735284:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1787784685.736042:0:16649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787784685.736049:0:16649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787784684 -> 1787784685 00002000:00010000:2.0:1787784685.736052:0:16649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787784684 -> 1787784685 00002000:00010000:2.0:1787784685.736054:0:16649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1787784685.736074:0:16649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736092:0:16649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736103:0:16649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736111:0:16649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:2.0:1787784685.736117:0:16649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736154:0:16649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736182:0:16649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736191:0:16649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3af227e/0xffb8d925c20bc048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787784685.736318:0:16649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:2364:x1874627634788608:12345-192.168.202.59@tcp:4:dd.0 Request processed in 137251us (148841us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787784685.736338:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1787784685.736422:0:16649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1787784685.736437:0:16649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:2365:x1874627634788736:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:2.0:1787784685.736479:0:16649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736496:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.736500:0:16649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787784685.736508:0:16649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787784685.736521:0:16649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737675:0:16648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737705:0:16648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737716:0:16648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737723:0:16648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269ea00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784685.737728:0:16648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737737:0:16648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737759:0:16648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.737767:0:16648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae15724/0xffb8d925c20bc041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.738202:0:16648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+18:2364:x1874627634788224:12345-192.168.202.59@tcp:4:dd.0 Request processed in 144378us (157306us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787784685.738215:0:16648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1787784685.738252:0:16648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1787784685.738264:0:16648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:2365:x1874627634788992:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:1.0:1787784685.738301:0:16648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.738322:0:16648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.738326:0:16648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.738333:0:16648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.738344:0:16648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787784685.808729:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1787784685.808968:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1787784685.808974:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:1.0:1787784685.808994:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809010:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809022:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809031:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513c00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784685.809037:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809049:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809104:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809113:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d79208e0/0xffb8d925c20bc03a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.809253:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:2364:x1874627634788352:12345-192.168.202.59@tcp:4:dd.0 Request processed in 228144us (228766us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787784685.809267:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1787784685.809306:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1787784685.809320:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+16:2365:x1874627634789120:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:1.0:1787784685.809396:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809411:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.809416:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787784685.809424:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.809437:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813124:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813190:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813202:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813210:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269fc00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784685.813216:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813227:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813253:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813263:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e19af9b/0xffb8d925c20bc04f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.813417:0:16650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943081d24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c50cf92d-6067-4c10-bfbc-11c55aeaf749+15:2364:x1874627634788480:12345-192.168.202.59@tcp:4:dd.0 Request processed in 212100us (225882us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787784685.813431:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1787784685.813478:0:16650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1787784685.813493:0:16650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c50cf92d-6067-4c10-bfbc-11c55aeaf749+14:2365:x1874627634789248:12345-192.168.202.59@tcp:4:dd.0 00010000:00010000:3.0:1787784685.813546:0:16650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813569:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.813574:0:16650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787784685.813597:0:16650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.813611:0:16650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787784685.878642:0:16649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1787784685.878657:0:16649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1787784685.878677:0:16649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878693:0:16649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878702:0:16649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878710:0:16649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9431bf7f0400 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784685.878716:0:16649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878726:0:16649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878777:0:16649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.878785:0:16649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f52a95a/0xffb8d925c20bc056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.879311:0:16649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff943189162940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c50cf92d-6067-4c10-bfbc-11c55aeaf749+19:2365:x1874627634788736:12345-192.168.202.59@tcp:4:dd.0 Request processed in 142870us (285320us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787784685.879326:0:16649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00010000:00010000:0.0:1787784685.879480:0:16648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879494:0:16648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879502:0:16648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879524:0:16648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181513000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:0.0:1787784685.879529:0:16648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879538:0:16648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879551:0:16648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787784685.879560:0:16648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e6a32e/0xffb8d925c20bc05d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787784685.879619:0:16648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c50cf92d-6067-4c10-bfbc-11c55aeaf749+17:2365:x1874627634788992:12345-192.168.202.59@tcp:4:dd.0 Request processed in 141358us (279144us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787784685.879627:0:16648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000001:00080000:3.0:1787784685.879716:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:2.0:1787784685.925021:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1787784685.925423:0:16650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1787784685.925448:0:16650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925465:0:16650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925475:0:16650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925483:0:16650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94308269ec00 already unused, calling callback (ffffffffc162b420) 00010000:00010000:3.0:1787784685.925489:0:16650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925499:0:16650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925541:0:16650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787784685.925551:0:16650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000057e2137/0xffb8d925c20bc06b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787784685.925683:0:16650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c50cf92d-6067-4c10-bfbc-11c55aeaf749+7:2365:x1874627634789248:12345-192.168.202.59@tcp:4:dd.0 Request processed in 112189us (324946us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787784685.925696:0:16650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00010000:00010000:1.0:1787784685.928239:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928285:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928296:0:15105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928305:0:15105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff943181512000 already unused, calling callback (ffffffffc162b420) 00010000:00010000:1.0:1787784685.928310:0:15105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928322:0:15105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928344:0:15105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787784685.928353:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816e2ed4/0xffb8d925c20bc064 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787784685.928574:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2365:x1874627634789120:12345-192.168.202.59@tcp:4:dd.0 Request processed in 119252us (328009us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787784685.928597:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00010000:00010000:0.0:1787784686.518433:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787784687.544863:0:14404:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787784687.629803:0:16688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1787784687.868683:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868730:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868760:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868786:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868820:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868840:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1787784687.868859:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789760 00000100:00100000:3.0:1787784687.868867:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789760 00000100:00100000:1.0:1787784687.868913:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790016 00000100:00100000:3.0:1787784687.868914:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789632 00000100:00100000:1.0:1787784687.868917:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790016 00000100:00100000:3.0:1787784687.868918:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789632 00000100:00100000:3.0:1787784687.868931:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634790144 00000100:00100000:3.0:1787784687.868934:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634790144 00000100:00100000:1.0:1787784687.868941:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1787784687.868948:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787784687.868950:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634789760:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784687.868956:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787784687.868971:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789376 00000100:00100000:3.0:1787784687.868974:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789376 00000100:00100000:3.0:1787784687.868998:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:3.0:1787784687.869004:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b9fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2364:x1874627634789376:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1787784687.869036:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634789760:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.869044:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1787784687.869062:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1787784687.869069:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634789632:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1787784687.869078:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789504 00000100:00100000:2.0:1787784687.869081:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789504 00000100:00100000:2.0:1787784687.869236:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627634789888 00000100:00100000:2.0:1787784687.869240:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627634789888 00000100:00100000:2.0:1787784687.869262:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1787784687.869268:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+20:2364:x1874627634789504:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784687.869321:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b9fecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:694b64e1-3991-40c4-9fdb-8a8fe572759c+13:2364:x1874627634789376:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 316us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784687.869327:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:3.0:1787784687.869359:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784687.869391:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784687.869398:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634790016:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784687.869422:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634790016:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784687.869428:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1787784687.869440:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787784687.869446:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784687.869452:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634790144:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784687.869474:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+5:2364:x1874627634790144:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 22us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784687.869479:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1787784687.869497:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:3.0:1787784687.869503:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2364:x1874627634789888:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1787784687.869528:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e94ca4a8-f17e-4bfb-939c-0ba59f45e136+6:2364:x1874627634789888:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787784687.869533:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00080000:3.0:1787784687.869552:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787784687.869557:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787784687.869559:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787784687.875523:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c50cf92d-6067-4c10-bfbc-11c55aeaf749+5:2364:x1874627634789632:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 6441us (6704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.875541:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1787784687.879144:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c50cf92d-6067-4c10-bfbc-11c55aeaf749+20:2364:x1874627634789504:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 9865us (10461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787784687.879158:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1787784687.926543:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787784687.926577:0:3293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643163648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787784687.926663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787784687.926868:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874627643163648 00000100:00100000:1.0:1787784687.926877:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874627643163648 00000100:00100000:1.0:1787784687.926946:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787784687.926956:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643163648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787784687.926998:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1787784687.927051:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9431b3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1874627643163648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787784687.927057:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787784687.927321:0:14412:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787784687.927348:0:3293:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787784687.927355:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff943189161e00, transno 8589934595 00000004:00080000:0.0:1787784687.927405:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787784687.927431:0:3293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff943189162d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3293:1874627643163648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787784688.571316:0:14405:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30143 lines, 30143 kept, 0 dropped, 0 bad.